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PREFACE , 

./ .It' is our shared opinion that what is learned In school mathe- . 
matins differs sharply frooi the outcomes desired by mathematics 
educators. We feel that curriculum and instruction in school mathe- 
matics is heavily in^'luenced by the reflections of 'i nd i v i dua 1 s \*ho, 
having successfully completed their own study*, possess well organized 
and coherent conceptualizations of a very large bgjdy o-f knowledge. 
Within that body of knowledge is a t'ghtly conceived logical network 
which guides the organ i zat i on ^of curtTculum materials and instructional 
procedures for school mathem^ics. Such a logical organization, the 
reasoning goes, should produce the desired outcomes. 

■ Unfortunately many students study mathematics for years and in 
th«*-end, ejchlbit jarring voids in their own ability to use mathematical 

tools in very simple and presumaj^ly. logical ways. ^Herc we find a dlleiwia 

^ ... . ' " 

The investigation we have reported is primarily a description of 

how college students actually solve or fall to solve algebraic equations. 

We have focused 6n describing the behaviors exhibited together with the . 

spoken desc r i pt 1 ons tpf process. [Where possibly we have provided a 

theoretical framework for these data. The reader will find evidence of 

the thought processes which operate. They appear to qs to be very dif- 

fercnt, even airong good solvers, froni those thoughts and actions which 

seem to be 1 09 1 caT expectations. Algebra may be generalized arithmetic* 

frofn the mathematician's ^polnt of view but our data suggest that few 

colles^e students have'^th^it perspective. 



. . . r 

\ \ \ o 



Perhaps, as researchers accumu late^ more Information of the sort 
reported here, the basis of curricula and Instructional deci s i ohk.wi 11 
shift In direction away from ""what log.lcally ought to be the outcome" 
toward "what is^the observed outcome". This is our hope. 
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CHAPTER 1 

* 

Introduction 

Many high school graduates today ar^ restricted in career choices 
by the lack of adequate and proficient knowledge in mathematics. One 
key Component needed for entry especially i.nto sci enti f i c caceers Is 
fluency In algebraic equation solving- This study was intended to 
develop a coherent description of effective and efficient algebraic 
equation solving and of those factors that interfere wii:h such perfor- 
mance. This is an early stage in a line tf ^invest fgation which should 
ultimately yie^ld implications for the learning and teaching of algebra. 

This report presents de ta I 1 ed information about the way In which 
certain university stu<Sh?nt5 solve and fail to solve equations in elemen- 
tary algebra. Understanding the solution process as It is actually 
carried out by students will hopeful fy aid teachers to transmit success- 
ful methods and prevent the development of unsuccessful ones. Equation 

jiving involves a complex Interplay of many forms of knowledge- We 

'A 

tried to use our study of thls^ task to shed new light on such perennial 

Issues 'in the psychology of proKlem-sol vi ng as the role of understanding, 

as wVl! as more recently ra i sed quest Ions In the psychology of skill, 

in interpreting the data^ we looked for three kinds of conclusions 

relevant, to education. First, we tried to identify and classify' the 

difficulties students had, and to guess the mechanism tha^ produced those 

difficulties, whether the mechanism was lack of a specific piece of Jcnow- 

Icdge or the failure to carry out a process. Such ideas about mechanisms 

should be useful in suggest i ng ' countermeasures for these errors: an error 

that results from a spec I f Ic wrong idea cannot be overcome by emphas i!^ ,on 
r 

1 

> . . . , . 



cdfclul or neat work,, while art error in execution might be. Second, we 
compared the work of successful and unsuccessful solvers, looking for 
ideas that might help make more solvers successful. We wanted to ff^d 
differences In the way solvers worked on the problems that go beyond 
the presence or absence of errors. 

Third and iwre generally we tried to identify what must be learned 
by the student of equation '-olving, following this question whsrever it 
led. We stcirted from the legal moves of the algebra game, were led 
Immediately to the knowledge that underUed an appropriate choice of 
move, and eventually to the knowledge that permits the legal moves and 
illegal moves to be distinguished. We have also suggested that there is 
information of a higher order relating these three kinds o. Knowledge 
that may be very important to learners and teachers. 

Psychologists of problem-solving have long distinguished .insightful 
behavior from un t ns I ght f u 1 , without being able to precisely trace the 
boundary-^between them. Equation solving is an interesting task partly 
because it is possible to envision both uninsightful and insightful ways 
of performing it. We have found human performance mixing these two 
approaches, and have seen In some specific cases what undprstanding does 
ana does not do. 

Recent work in the psychology of skill by John.Seely Brown and 
others, some of it directed specifically to algebra, has suggested how 
the ability to pe -form a complex task is developed and- how failures occur 
and are handled. We have examined segments of boravlor which can be used 
as examples in evaluating and^chaps extending these' ideas. 
Related work 

There has been lltt'e empfrical study of ordinary algelsra, (;lespite 



Its Importa/ice. Brown and his associates '{Brown, Burton, et al 1975) 
coJ lected -and interpreted errors from college students in remedial 

!* 

'courses, ^he present work can be seen as an attempt to carry forward 



the analysi'^ of solving behavior begun by- theii\, Matz (1979a, 1979b) ' ;.' 
has also been pursuing and extending this work, concfentrat'ing on \ 



mechanism underlying errors. Davis and Cooney (1977) have collected 
errors from high school students. We have been able to supplement 
their findings with' data 'from a wider class of problems. The theoret- \ 
ical v^ork of Bundy (1975) in developing an equation ^sol vi ng computer pro- 

r 

gram has been discussed at some length below. 

The enterprise of developing detailed accounts of behavior has been 
carried out nx>re widely in other areas of mat"hemat i cs , es]DeciaUy arith- 
metic. Most closely related is the work of Suppes and Morningstar 
(J972), that has been followed by Brown and Burton (1378) and Larkin' 
(1978). The techniques of representing procedural knowledg^ developed • 

in this later work, and i^j^ art i f i c 1 a 1 intelligence by SacerdotI (1977), 

« » 

are now'being extended to simpler skills such as counting by several 
investigators. Van Lefin and Brown (1978) discussed these techniques. 

\ 

Neves (1979) is develojsing a' model of the process of learning to solve 



^quat ion^ -frorn examples , ^> * . ' 

Ov erview of the study \ ^ 

\ 

We collected protocols from tivo groups of univ.ersi^ty students sol-- ' 
.ving elen-tentary algebra equations. One_grpiip of students was selected 
for profi-ciency fro?n a population of engineering and mathematics educa- 
^J^on students, who were expected to be good solvers. The other group 
was an unselected sample of volunteers from an Introductory psychology 



course. M^ny ''students in this group were pQor solvers^ so we were able 

to^^cooipare good ^nd poor performance, Thd'wrltten work^of'each studeJit 

' ^ ' ' ' I 

and any spoken comments were retained for analysis, and ;oe^comments 

were keyed to the written work .using . video recording mad^of the soN 
ving sess ion, - ^ ♦ ^ 

To organize ttiis iarge^ rather unstructured body of data, we used- 
an artificial model of the solution process, bas6d on the work' of Bundy 
(197^). This artificial mode^T^'descr i bed In detail below, ^is perhaps - 
the simplest system rea 1 i s t I ca 1 1 y capab 1 e of equation solving. The com- 
plex data actuaUy obtained from human solvers can be compared v^ith the 

' ^ ' ... 

predictions of this simple model to bring into relief thos^ aspects 6f 
human solving that deviate from it. This served td' separate character- 
istics of the human pe r f ormapc^-^whicb ^simply reflect the demands of the 
task, and hence agree with the simple model, from those that indicat^ed 
the human contribution. 

The body of the report is organized as follows. Following a de- 
scription of the materials and data collection procedure, including the 
recruitment of subjects, summary of performance on the task Is given. 
The ^{jndy modei^is then described, so that the details of performance 

can be. related to it. Strategy, errors, and speciaj features of skilled 

*^ 

performance are considered, followed by discussion of aspects of the 

» 

data that require departures from the simple model. 



CHAPTER 2 



Development of the Kesearch Instruments ^ 
, Procedures and Performance Summary 



The equation solving behavior under investigation centers, around 
the type of equations (linear, quadratic, and' f ormu 1 as') found in 
elementary and i f^termed i ate level hiah sch^^t^lgebra courses. Since 
the^:^cont rast betwe^/good and poor performance was to .be made with 
college students, there were questions concerning the appropriateness 
of the equations tgr be used. A series of twelve. (12) equations con- 
taining such features as parentheses, fractions, signs, and literals 
was pilot tested (see Table 2.1) with a small group (about 20) of 



subjects representing the population of less ppo^iclent solvers 



Table 2.1 



Equations Used In Pilot Testing 



1. - 2 - 18, 



3. X - 2 (x + 1) 1/+ 



5. 6(y-2) -3 (^-2vi - y-12 



sol ve ,for b 



9. 5 



2. 11 - 2x - 3x + 17 

^. A = p + prt; $olve for p 

6 . - 3ji , 8-4x 
2 7 

8. X + 2 [x+2 (x+2)] - x>2 
10. + 3 « (x+5) (x-i-9) 



Pilo^'data w,^ re examined for equations which were challenging, but 
not cumbersome. On this basis, certain of the pilot equations were 
omitted and new equat i ons -added . The final instrument is shown In 
Table 2.2. ^ 

Table 2.2 _ 

u 

Ec^ations used in FiTTSt Session 



lA. A«p+prt; solve for p 



2A. 1 ] 1 

..3 X ^ 7 



3A. 9(x+i40} - 5(x+i40) 

4. 

hh. xy+yz.- 2y; .solve for x 



IB. 2x - x^ • 

2B. 1111 

X ^ y z ' solve for x 



5A. 5_ 
10 



x-]0 



6A', x+2 (x+I ) = A 
7A. x-2(x+l) - \k 



5B. 1 - . 

~. = 2 

1 - X . 

^ 

6B. x-t-2(x-t-2()^+2)) = x+2 
7B, 6(x-2) -3(^-2x) - x-12 



This instrument consists of seven (7) pairs of equations. Each " 
pair was designed to probe for specific errors observed in the pilot 
data. These problems were given to all subjects in the first of 
two session^. In some- cases the equations share specific structural 
features, other times they vary in some systematic way. 



16- 



t Corresponding to the seven pairs of equat i ons ^used in Session 1, 



I 



the seven triples of similar equations shown in Tablf2 2.3 were con- 
strutted for Session 2. The latter were I^ntended to permit an error 
seen in Session .1 to be elicited for d/scussion in Session 2. 

Four pairs of nx>re' comp 1 ex equations of the same general t#pe as 



those for Session 1 were al so prepared for us^ in Session 2, to aUow 
the performance of skilled solvers to be assessed on more d^lcult 
material. These equations are "shown in Table 2.k 



Table 2.3. ^ 

'Session Two Equations 
for Unselected Group 



■4 

.IE 

2C 

2D 



A = 2k<S. +2kh + 2wh solve for h 



.2 




\ 



^ > b + 1/c 



' X+1 

2E , I'/x + 1 



+ 3 =. 0 ■ 



|C ' 9(7x-15) - 8(7x+15) + 7 

3D 2ikx'2) -»-l''(2x-l) - k 

3E . , 2(3^x),. 4(x+3)>1?. 



xy + yz + xz " 1 
^0 * . Ijcx + acx + abx + abc - 0 

, . ax + b)< + ab - 2x + 23 .. • 



8 



' Table 2.3 continued 

sc.- 

. 5E 

6C 

6D 

' 6E 

7D 
7E 



2, , 



1+x 



3(x+3) 



c/3 



x+) 



'X ^ 2. . 

{jVx} 3+x - 1 o 

x-2{x-2(x-2)) - x-2 

x^ -. (xH)(x-2) « 9 
7 . x+3 .c 



Table 2.^ 



1/x 1/x^ 
1/x + 2x^ 



B1 /1/x - 

^ M-X 



Session Two Equations 
for Selected Group 



CI 2(W2) - 3 .{l+2x) * 0 



Dl (r-^y^^z)x . . 
1/p+l/q 



A2 3x+5(x-3) - 5x+3)-3(x-2) 



B2 



x-b 



c + d 



C2 , 3(x+(a+b))+2(b-»-(x+a)) -1 
D2 y+2| 



{4 



, An instrument for screening the more proficient, fluent solvers 

on the basis of speed and accuracy was also developed. Equations like 

those in Tabje.2.2 or with added complexity, were se|jected. The equ^- 

tions fop the screening instrument are shown in Table' 2.5. 
e ' < ■ 

« * 

Table 2,5 

Equation^ Used to Screen 
Selected Group 

>* 

,1. 3x"- 2(x-5) « 2. " 2. ■(2X-3). -3(x-6) «\ 



3. ' I 



x^2 2-x ^2„^ 



3x+8 k. 5-3[2x -2 {5-3x)] - i*(2-3x) 



5- ^-1^1.^'^ .,3 6. 2^ J5_. 1 



1. {2x-^l) (8x-3) « (^x-l)2 8, 



9. A -Trr^ 2*Trrh; solve for h ^10. 1 _ 1 



- - r T ; solve for B 

a b c * d 



11. , X - -3 -.^2x " J_yi 12. 3x-x^ 



0 



13. x-3(x+3) * 0 H. 1 (x+2) -5 (x-8) l(x>'l2) 

'5* iiri. - ^ 16. 2 1 

■ ^ - x2-l x-1 • 

17. X - 10 ^- (10%)x 18. X- ■>■ 7y ^ ^ 3y-^x; solve for /x^ 

19, 5x - x+l_ ■»■ 6 - 0 
x+1. 



" Subjects t Two groups of university students served as subjects. The 
unseleq^ied group consisted of nineteen volunteers from an Introductory 
Psychology course, who received course credit for their participation.- 
These students were not selected by the experimenters; preliminary 
work had shown that this pool of 'subjects Included many poor equation 
solvers. Participation was voluntary, and three other students declined 
to participate after the study was described to them. Data from three 
more students were lost to technical failure. ' 

The unselected group varied 1 n mathemat i cal background.- All had 

>^ 

had two years of algebra In secondary school, but some had continued to 
take mathematics In col lege and others^ had not. The time elapsed be- 
tween-initial learning or' last use and the time of this study must be 
kept in mincMn considering their performance in the study.' Specifi- 
cally, it is likely that memory retrieval difficulties played a greater 
role of this group than It might in a corresponding study with high 
school students . 

The fifteen students in the selected grou/ were recruited as 
follows. A screening test (Table 2.5) was administered to 91_ students 
in a junior-level electrlc.il engineering laboratory course and 20 stu- 
dent mathematics teachers. The test was given in a classroom setting, 
and the students were asked to record the time they started and finished. 
All tests were scored for number of equations correctly solved. 
Performance of the group ranged from k to 19 correct solutions and 
from 8 to 3CX minutes to complete the test. • . ' 

r 
r 

The 2^ students who had 16 or more correct solutlqns were selected 
for telephone contact. Of these k could not contacted, declined 



J 



12" 



to participate. 'and )6 serv.ecl as sujbjects. One student's datd* was lost 
due to techn ica I , fai I ure . / 

These students were paid $5-33 for a 1 1/2 hour session. 

Procedure / . . ..^ 

All students served individually in the experiment. On arrival^ 

If- 

each student heard^a general description of the experij)tent and its 
goals, and ^.decided whether or not to pari^i ci pate . General instructions 
were then given, In which the student was asked to solve a series of 
algebra equations, by whatever n)ethod the student chose while being 
video-taped. No srmpUff cation of answers was required, and the student 
was free to write down as many or as few steps of the solution as de- 
sired. The student was asked to resist the temptation to be unusually 
careful or clear in working on the problems and not to worry about mak- 
ing mistakes. It was explained that^jo record of the student's Identity 

m 

would be kept^ and that the video tapes would not show the face. The 
student was free to skip or abandon an equati9n at any time. A pen was 
provided to prevent erasing. Questions were encouraged at any time dur- 
ing the procedure. 

The instructions also called for spoken comments during the solution 
process. For the first seven equations, the student was told ''As you 
work, try to describe your problem-related thoughts. Don't worry about 
feeling foolish, but just try to say whatever comes to mind as you work.'' 
For the second sevfen equations the student was asked to explain the sol* 
ution process as I f to a person studying algebra who asked for help on 
homework. Comments on how to decide what to do with an equation were 
_5pec j f I cally requested . 
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The first two sets of seven cqu^t^ons were drawn from the set 
shown in T^b.)6 2.2. These were presenteJ in a random order, with the 
priviso thay one equation in each of the pairs shown in the table fall 

In the first, seven and the other in the second seven* Working time for 

< ' ■ ' ** 

these \k equations ranged from 10 to 30 minutes. 

After completing the work on the first two sets, the students in 
the Selected group were given two more sets of four equations each. 
These sets were drawn from Table 2,^, with the requirement that one equa- 
tion from' each pair fall In each set. The first set w^^0*lved under the 
^'describe your thoughts*' Instructions, and the second under the "explain*^ 
instructions just as for the Initial sets of seven. Working time for 
✓ these 8 equations ranged from 15 to 30 minutes - 

The Unse])£5cted group was treated differently. The first sets of 
seven equations completed the first session, and they returned a week 
later for the second session. In the interval their initial work was, . 
examined, and sets of equations related to those on which they had made 
errors were selected from Table 2.3* Three sets of three equations were 
prepared for each student, with equations that had been little used to 
that point, being used to fill/out the count for students who had lot 
nade errors on three different types. These three sets were presented 
in random order, with the equations within each set also randomized. 
The students were asked to comment on their solutions under the ''explain'* 
instructions 35 used in the first session. In addition, the experimenter 
asked forcommepts on particular features of their solutions or comments, 

i' 

This second session lasted ab6ijt 25 minutes. 
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All' solutions anjd comments were recorded in the following manner. 
Each equation was written at the top of a blank 3j x II sheet of 
paper. The student was seated at a table with this sheet placed in a 
convenient position for writing. The experimenter was seated on the 
opposite side of the table, controlling' a video camera wit^ a zoom lens. 
The camVra was aimed at the area of the sheet on which the stud^ntylas 
writing. A small TV monitor was placed on the table in such a way that 
the experimenter could follow the written work and guide the camera by 
viewing the monitor, A desk lamp was used to fill In shadows cast by 
the student's writing hand", otherwise no special lighting was used. The 
student was told not to worry about blocking the camera or moving the 
worksheet as the experimenter could move the camera. A microphone 
placed on the table near the student recorded the consents of both stu- 
dent and experimenter on the video tape. Additionally, an audio cassette 
recorder with a lapel microphone worn by the student was used to capture' 
the comments In a form more convenient for transcription than the video 
tape, ^ 

Spoken comments of subject and experimenter were transcribed, with 
pauses indicated by slashes timed by a metronome running at ^0 beats per 
minute,' Numbered flags were placed on the written work for each solu- 
tion indicating the order in which lines or parts of lines were written, 
by reference to the video recording, Subscripts corresponding to theSe 
flags were placed in the transcript of the comments to indicate the re 
latlve timing of comments and written steps. Flags also were used to 
show where the subject pointed when no mark was made. 
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Table 2.6 shows the^ performance of the subjects on the Session I 
equations. The symbol 'e" in the table Indicates that^ the subject com- 
pleted the ::!|problo<t but made one or more errors in the solution. The 
symbol "n'' indicates that the subject did not complete, the problem. 
A number Indicates t\i^ the correct S' 1 ut i on^ was ,at tai hed , and gives ^ 
the number of written steps in the solution, excluding false st;arts and 
backt rack i ng » The steps counted were the lines showing successive 

» 

transformations of the equation, withj marks added to such a line not 
counted. 

Subjects are designated in the t«ble and throughout the report by 
the codes assigned them when they arrived to participate in the study 
so there are gaps in the numbers for subjects whose data were lost or 
who declined to participate after being assigned a code. Codes start- 
ing with S were assigned to the unselected solvers, and those starting 
with E to the selected solvers: the letters may be taken to stand for 

r 

Solver and Expert, These subject codes wl ! 1 be joined with equation 

m 

numbers to Identify examples discussed In the report. The designation 
SI would identify the work of subject SI on equation ^B. 

Table 2,6 displays the subjects' grouped according to the number of 
Session I equations they were able to solve. In Table 2,6 and in the* 
grouping one error d 1 scussed^below Is not counted: Equation 5B has one 
as an extraneous root^ but In Table 2-6, one was counted correct. This 
was done to avoid placing undue weight on correct handling of the rare 
extraneous root problem In ranking the solvers. As long as any partial 
credit Is given for one as a solution to 5B^ ithe group! ng^^shown Is un- 
changed. ^ ...l^ 



Interestingly, there was little di,fference overaU In the lengths 
of solutions generated under the ''descrJbe your thoughts" and "explain' 
instructions.. Tho average acros's equations of the average solution ■ 

length for '^describe your thoughts" solutions to the Session 1 equa- 

f 

tions was 3-^ steps, and for "explain", 3-7. The "explain" solutions 
were longer for 9 of the U equations and shorter, for the other 5. 
Though this in^cates thlK the difference was not consistent for equa- 
tion IB, the increase in length under "explain'' instructions was sig- 
nificant (rank sun test, T' - 15^.5 pCOOl). 

Tables 2.7 and 2,8 show the correctness of solutions for the 
Session two ' <;quat i ons . , Here "c'' means correct, '"e" error as In Table 
2.6, and "n" not completed. The symbol "t" indicates a problem not 
completed because of Insufficient time. 
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Performance on Session 1 Equations 
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Table 2.6 continued 
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Table 2.6 continued 



Bottcfn Ten Solvers 
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e - denotes error 



n - denotes not complete 
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Ta^le 2.7 



SI 
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'Performance on follow-up equations 
for unselected group 
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,c denotes correct 
^ - denotes error 
n - denotes not completed 
t - denotes Insufficient time 
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Performance on Session Two Equations 
for Selected Group 
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n - denotes not completed 
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CHAPTER 3 " > ^ 

The Bundy Model , . 

Bundy (1976) presented an outline of, the organization of a program 
to solve equations. Though his model is^ot intended as a psychological 
model, i f nevertheless makes a convenient starting point for considering 
human performance. 

The program, operates on tree representations of equations, as in 
^'Jjl^ '* ^^'^ representation avoids the need for parentheses and- makes 
opiiSrator, operand relationships easily apparent. 

Figure 3.1 

Tree representation of the equation 5x - 3x + 1 





3 



The trees are transformed by the application of operators (called axioms 
by Bundy) selected from a store. The operators are straightforward uses 
of arithmetic principles. Examples appear in Fig. 3.2. 



Figure 3*2 
Example Op#fators 

^ V u * rV 

(u^v)*V > u 

w • {u>V) w»u ^ V*w 

W'U -f^ V^w w • (u -f V) 
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Each operator has an ^o^^ pattern; which must be matched In applying the 
operator, and a new pattern", showing how the-^perator changes the tree ' 
to which It is applied. The program has a pattern matcher which is able 
to tell when an old pattern can be matched to a tree and establish what 
parts of the tree co^rrespond to the variable? in the old pattern. The 
pattern matcher embodies principles like commutat i vi ty and associativity 
of addition and multiplication. This means that operators need not be 
stated in different forms to apply to trees which differ simply in order 
of addends, for example. The pattern matcher is also able to call the 
equation solver recursjvely to determine complex matches. An exampfe 
Is presented in. Figure 3*3 below, 

Several operators, typical Uv ^re applicable to a given equation 
Hree, The selection of which operator should be used ^s governed^by 
simple heuristics that partition the operators into groups appropriate 
to reaching specified subgoals. These subgoals break up the solution 
process into phases, which can be described as follo^vs for an equation 
that rnitlally has two occurrences of the unknown. 

The first phase is attraction ^ which has as its goal the rearrange- 
ment of the occurrences of the unknown in such a way that one can be el Im-- 
inated by a further operation. Attract I on ' i s guided by jieuristics^that 
Identify the smallest subtree of the eqijatfon containing the occurrences 
and that try %{> reduce the number of links of the tree connecting the 
occurrences. Operators that have this potential are designated "helpful 
to attraction" In the operator store. 

Col lection Is the phase in whi ch occurrences of the unknown are 

actually eUmlnated* To limit search, only single operators that could 

eliminate an occurrence are considered. As for attraction, attention Is 
* * * ^ 
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focused on the smallest subtree containing the occurrences of the un~ 

4 

known when matches are sought* and operators useful to collection are 
marked in the operator store. 

If more than two occurrences of the unknown are present, attrac- 
tion and collection must be repeated. If only one is present, they can 
be skipped, and thk final phase, isolation , entered at once, Thfc goal 
of isolation is to renx>ve any structure in which the unknov/n is embedded, 
leaving the equation tree in solved form. 

At the end of each phase a rudimentary simplification Is performed. 
This IS limited to the removal of zero from sums and oth^r such routine 
simp] I f icatJons. No multiplication, factoring or other rearrangements 
are performed. As with the pfiase described above, operators appropriate 
for simplification are designated in the operation store. 

Figure 3*3 shows an example of a solution illustrating the operation 
of these phases . ^ 

Figure 3-3 

' , The Buhdy Program Linear Equation 



EQUATION 
5x - 3x ^ 1 



OPERATION 
u » w-v 

U^,^ V ■ w 



PHASE 



attraction 



5x ^('3x) - 1 



W'U + V'W 

w » (u+v) 



col lection 



x (5 ^ -3) - 1 



arithmetic done in 
simpi I f icatlcn 



X (2) - I 



X - 1/2 



U'V " w 



I solat i on 



u • w/v for v/0 
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Figure 3-^ shows a more complicated example taken from Bundy (1975) % 
which the pattern-matcher calls, the equation solver recursively to 
solve a quadratic equation, 

Figure 3.^ 
The Bundy Program - Quadratic Equation 
EQUATION^! DISCUSSION 



2 



c 



ax2 + bx + c » 0 ^Collection tries the operator 

u^ 4 2-u.v + v^ >(u+v)2 

to collect the x*s in ax^ + hx.^ 
Choosing u as the. variable to 
be matrhed with x, the structure 
containing the u's, + 2*u*v 
Is identified^ and the operation 

changed to u^ + 2*U'V • 

(u+v)^ - v^. In matching 
x2 ^ 2-x-v to ax^ + bx the pro- 
gram tried to find a w that can 
be multiplied times x^ +-2xv so 
that W'l. « a and w.2-v * b. 
These simultaneous equations are 

solved, giving w - a, v « b_. 

2a 

So the operation performed Is 
ax^ ^ bx ■ » w j^(u+v)2 ^ v2 j 
which is 

Isolation now proceeds, since 
there Is just one x- 



3-1 , 
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Figure 3..^ cqntinued 
a fix + b \ 2 . /bj 



-c 



a 



(" * t=y, ■ fe) 



a 




2 . c 



This '/s the equivalent to the familiar 



2^ - tf. 



The objective of Bundy's program is the solution of the search pro- 
blem presented by the large number of operators applicable to a gjven 
equation. Other systems for algebraic manipulation (Hoses', 1971) solve 
the problem by reducing expressions to canonical forms that can be manip- 
ulated in standard ways. Bundy argues that his heuristic approach, which 
is extended in his paper to cover elementary function symbols as well as 
the four arithmetic operations, may solve a wider range of problems. In 
any case, since human solvers do not appear to use canonical forms, it 
•seems that Bundy 's use of heuristics for operator selection offers a more 
plausible point of reference fo|i*con side ring human solvers. 

In considering Bundy's model as an account of human solving, some 
changes seem called for Immediately. First ',t seems reasonable to replace 
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the equation trees by the ordinary written syntax used by the solvers, 
so that operations are formtjlated^as' operations on' strings. This makes 
it more difficult to determine the distance between occurrences of a 
symbol, as used In the attraction phase, but this Information is never- 
theless stiTl available. As will be seen, parentheses as used in the 
strin^v^tat ion seem to have some effects^n solvers' behavior, so their 
•incIu$ion"'Ts desireable. 

Second, Bundy's model is Intended to produce only correct solutions, 
so that all operations are mathematically valid, pattern-matching always 
respects the syntax of expressions and the actual execution of opera- 
tions is always accurate. Of course, these requirements must be relaxed 
In adapting the framework for a psychological model. 

In relating human performance to this simple model we^ wl 1 1 first 
discuss two areas in which useful .agreement is found: strategy , that is, 
the selection of o^serators to reach the goal of solving the equation, 
and errors , the |wa|s in which mathematically invalid results are obtained 
We then discuss some d i fference between skilled and less skilled perfor- 
mance that relate to the Bundy nxadel. Finally, we turn to a discussion of 
severa' aspects of human performance which seem to be outside the scope 
of the simple model. We wish to repeat here that the Bundy model Is not 
intended to be a psycho logical model, and our discussion is not a criti- 
cism of It but an attempt to use Bundy's insights to clarify the patterns 
In our data. f 
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CHAPTER k 

Strategy Analysis 

•The strategies used by sol vers , provides one important way of 
describing observable differences in solving behavior. In this 
chapter wr consider the strategies used fcfy the top ten solvers, the 
middle 14 soWcrs and the bottom ten solvers and discuss the relation- 
ship of those strategies to those suggested by the Bundy model. 

The Bundy model establishes priorities to guide the' choice of 
operations to apply to an equation^ Recall that the model first 
attempts to attract Instances of the unknown, moving them together, 
then to collect Instances so that only one Is left. If there Is only 
one instance, the model Isolates the unknown, stripping off any. oper- 
atlons In which It Is embedded. 

These priorities seem to agree reasonably well with those of 
human solvers, though there are some differences. Table ii.) displays 
the choices made by the solvers for each of the Vk equations In Session 1 
The choices mentioned are Illustrated In Table 4.2. The choices given 
are the Initial choices presented by the equation In Its original form, 
and a box in Table 4.1 indicates the choice favored by the basic strategy 

the Bundy model. No box appears for equations 4B, 5A, and 5B because 
these ecruations have x In the numerator and denominator of a fraction, 
and it Is not clear how the Bundy model would proceed in these situations 
The needed operation is to clear the frattlon, but no operator to do this 
Is :i$ted as useful for attraction \n Bundy '$ tentative list, perhaps 

* 

because It does not reduce the dlsta\e between the occurrences of x fn 
Bundy 's expression tree notation, ^^eems likely that such an operator 

■ " ■ 37 ■ ; 



Table k.) 
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Strategic choices ' 

Where the Bundy Model makes a clear choice, 
that fs Indicated by a box. 
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f ract Ions 

Other 

3A < 



Attract 



Multiply out 

ft 

Cancel or divide 
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(Attract 
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Table ^. I continued 



Equation 
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Tabic k.\ 'conffnued 
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distribute, collect 



Distribute, 
distribute, other, 
col lect 

'Other' '* 



Top, 10 
Solvers 



.8 



Middle U Bottom 10 
Solvers Solvers All 



12 



0 
1 
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Table k.2 



Illustration of strategic choices listed In -Table k,] 



lA col lect p's 
IB attract 

cancel or divide 
2A isolate 

f 

V 

clear fractions 
coflibine fractions 

28 As for 2A 

3A attract 

mul tiply out 
Cancel or divide 



A-p+prt-^-^A - p (1 + rt) 

2x"x2 >2x-x2 « 0 

Zx-x^ )2"x 



1. 1^- i 
3 X 7 



1. 1+ i 



3 
3 



1 - i ^ 1 



7 

I 
1 



1 

X 

7x 



1 1 
3 ' 7 

-21 + 3x 



1 ^ 7-^x 
3 7x 



9(x+i»0)-5(x+^O)- 
9(x-»-^0)-5(x+AO). 
9{x^^»0)-5(x+^O). 



-^9(x-A0)-5(x+^O)-O 
->9x+360««5x+200 
9-5 



Table k.2 continued 



A 



attract 7{4x-l )-3(4x-l 

multiply out 7(Ax-l)-3(^x-l)+i+- 

cance] or divide . 7 (4x- 1 ) «3 (4x- i )+^" 

introduce variable 7 (4x- 1 )«3 (4x- 1 



^7(4x-l)-3{i+x-1)-i* 
►28x-7-12x-3+4 



isolate 
factor out y 
Col lect x' s 

Clear fractions 
clear fractions 

simpi I fy 5/10 



collect by 
cancel 1 i ng 

clear fractions 



distribute and 
col lect 

distribute and 
col lect 

distribute twice 

cancel or divide 

distribute and 
col lect 

isolate X 



.7y«3y + 4 



xy+y2-2y » xy-2y-yz 

xy+yz-2y >y(x+z) - 2y 



x+3+x 



2x+3 



x2 ^ x2 



1 



5 x-lQ 
10" x+5 

5 - x-10 



* SCx+S) - lO(x-lO) 
1 - x-10 



10 

l-x 

l-x2 
1-x 



^2 x+5 
1+x - 2 



2(l-x) 



x+2(x+l) - k >3x+2-^ 

x+2(x+2(x+2))-x+2 — 4x+2(3x+4)-x+2 

x+2 (x+2 (x+2 ) ) -x+2 — > x+2x+/tx+8-x+2 
x«f2(x+2{x+2))-x+2 — > x+2 (x+2) - 1 
x-2{x+l) - \k — ^-x-2-li* 

V 

i 

x-2(x+l)-li» — >x - 1i|+2(x+l) 



distribute, 

distribute, collect 6 (x-2) -3 {^-2x)-x- 1 



distribute, 
distribute, other, 
collect 



->.12x-12-12~x-12 
6 (x-2) -3 {A-2x) -x- 1 2 >6x+6x-x- 12+12-12 
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should nonethefess be Tnclud^ for use in attraction, since It is 
sometimes necessary to set up collection. In equation 5B, collection 
is possible by factoring 1-x^ and dividing but it is' uncertain that 
the pattern-matQ^er would discover this, so no favored choice is 
listed. 

Of the 11 equations for which a choice !s favored by the Bundy 
strategy, the most common choice made was the favored one for eight 
equations. Equations 3A and 3B are two of the exceptions, possibly 
because the favored choice requires dealing-with repeated subexpres- 
sions as a unit- Equation 3A also offers a popular cancellation choice, 

which is not available as such in the Bundy model,. ^ 

f ■ 

In the other exception, equation 6B, human solvers prefer to 
complete the clearing of parentheses be^re proceeding to combine terms, 
whereas the Bundy model , would col lect x's as it went along. In fact 
the multiplying out of the parenthesized quantities would be just a part 
of a CQllection operation and would not be done separately. It seems 
from solvers' comments that clearing of parentheses or multiplying out 
is itself a subgoal for many^human solvers. 

Although the, Bundy model often identifies the most popular choice 

there are a number of minority choices that deviate from it. Cancel la- 

i \ 
tion, already ment I oned^-f<>r equation 3A, is popular on equation^lB and 

6B. The favored collection in equation lA' Is apparently difficult, and 

even though there Is no really viable alternative many solvers did not 

use It. Clearing and combining fractions are Important for equations 

2A and 2B, even^though they Increase the number of occurrences of x. 

Clearing fractions is also the most pop.,lar choice for 4b, 5A, 5B, 

whare agreement with the Bundy scheme cannot be assessed. 
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i . 

There Is some indication that better .sol vers may tend to agree niore 
with the Bundy choices than do poorer solvers. For the eleven equations 
where a choice- can. be favor.id, there is only one case, 7B, where the 

r 

bottom 10 solvers agreed with Bundy more often than the top ten, Equa- 
tion 3A is aV»e*- Some of the lack of" agreement of the poorer solvers 
comes from their having available spurious operations which lend them- 

r 

selves to deviant strategic choices. 

Consistency of strategic choices Do solvers' strategic choices reflect 
a stable hierarchy of preference, like that 'in the model, so that similar 
choices would be made consistently for similar equations? This question 
deserves more attention, but can readily be examined only for equations 
2A and 2t amtong the Session 1 problems, since only these two offer 
closely matched choices. As shown in. Figure ^.1, there is a strong 
-tendency for solvers to make similar choices on the two problems. 

figure ^,1 . 

Consistency of Str'Stegic choice for equation 2A & 2B 

Equation 28 



Equat ion 
2A 





1 sol ate 


Decol lect 


Other 


1 sol ate 


16 


1 


' 2 


Deed lect 


2 


6 


2 


Other 


2 . 


0 ^ 

1 


3 



. i3 



Quadrat ICS As shown in Fig. }.k, the Bundy system is able to solve 
quadratic equations without any adjustment of strategy or operators, 
essentially by inventing the method of completing the square for each 
such equation. No solver used this method in the study, "instead, 
either of two methods which do require a strategic adjustment and 
special operators were used. The contnoner method is factorization, 
in which the equation is put in the form (ax + b) (cx + d) " 0, and 
then split into two equations, ax + b » 0 and cx + d » 0, which are 
then solved separately. The other method is use of the quadratic for- 
mula, in whi.ch the equation is placed in the form ax^ + bx + c - 0 an^ 
the roots are obtained by use of a formula in a, b and c. Table k.3 
shows the frequency of use of these two methods for the Session 1 
equations. Cases are included whether or not the method was success- 
fully completed and whether or not its use depended on an error. For 
example, equations 6A and 6B are not quadratic equations, but by error 
the/ were sometimes turned into quadratics. As can be seen, only five 
students used the quadratic formula. Of the five, three were among the 
top ten solvers, and two among the middle 1^. Four of the five were 
members of the more experienced screened group* 

. Table 4.3 ^ , • 

Frequency of use of methods for solving 
quadratic equations In Session 1 

Ca$c5 . Students 

Factoring 48 26 

Quadratic formula ' 7 5 
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Both of these methods requ? re*5pcci at handUng. In both, the 
equation must be put In a form with zero on one s I de ,*1i»h i I e normal 
strategy for 11 near equat ions would often result in a non-zero con- 
^stant on the opposite side from the^ terms containing x. Further, both 

i 

the splitting operation and the use: of the formula would have to be 
specified by special operators.- 

Strategy di f f IciSl ties Some students appeared to have trouble select- 
ing an appropriate operator to apply. In the Bundy scheme, such diffi- 
culties would reflect flaws In the control^ st ructure that sequences the 
phases of. the solution process. 

Table k.k collects cases In which students isolated one occurrence 
of the Unknown when there was another occurrence that had not been 
collected, the many cases in which they occurred for equation lA, 
the difficulty was probably brougKt on by inability to recall the 

Correct collection operation. 

\ 

Table ^.^4 
Premature Isolation 

f 

)A S5,S6,S'12 A-p+prt >p - expr or 

S13,S15,S20 ^ ' -pp. expr 

S21,S22,S23 wh^e expr Includes p 

« expr, where expr . 
Includes x 



7A SI5 ; X'2U^\)m]k^x^]k^2ix^\) 



Table k.S shows difficulties associated with the transition be- 
tween .the strategy of separating unknown terms from constants, which is 
appropriate for 1 1 near equat Ions , and the strategy of gathering all 
terms on one side with zero on the other, which is appropriate for 
quadratic equations. The moment of decision is shown in the first 
case, S6 6B. The remaining cases under the "quadratic"' heading are 
failures -to set equal to zero at the appropriate moment. In the first 
two., E4 ^ and S12 4B, the solvers did go on to do this ^. In the re- 
maining cases» S7 l^B and S16 kB^ the solvers did not, but instead used 
invalid operations to "solve" the problems. So these solvers may not 
have made any strategic distinction here. 

^ The cases under the heading "linear" are ones in which the "set 
equal to zero" strategy was applied to linear equations. This is not 
mathematical^ Invalid, assuming It Is done accurately, but it does 
Involve unnecessary steps. In the first example shown, found in the 
work of two solvers, setting equal to zero is followed by factoring.* 
as It might be for a quadratic. Again, this is mathematically valid,' 
but of questionable value. The move might be worthwhfU if it allowed 
the correct conclusion to be drawn about the role of y: that If y is 
zero than any value of x satisfies the equation. Nelthei itudenjt drew 
that. Inference, though S13 did get as far as "I'm not sure about this 
right here but I think you can get y equals zero and thi^n ,x plus z plus 
two equals zero" before abandoning the problem. 

Table ^.6 shows some more dramatic failures of strategtcf^ control . ' 
In each case, an earlier error resulted In. the elimination of all 
occurrences of the unknown from the equation." A strategy that aimed at 
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Table k.5 



4 



Strategy shift between Unear 
and quadratic equations 



Quadratic 
-56 6B 



S12 kB 
S7 

S16 kB 



2x+3-x2 >3-x2-2x 

2x+3-x2 >x2-2x"3 

x2 . X+3+X — >x2-x^x-3 
2x+3-x2 »2x+x2-3 



"I 'm trying to figure out 
if you can carry it further, 
1 don 't think so. I bring 
the four to the other side. 
I get X squared pliis four 
oh ah, you could bring the 
one to this side so it'll 
be equal to zero." 

"get the x's together" 



L I near 

S3. 
SI3 



S13 2B 

4 

S13 5A 
S13 -76 



xy+yz«2y- 



xy+yz-2y"0' 
y(x+z-2)-0 



]_ 
R 



X y z^"" X y zR 



5x->'25^0x^l00 — >0-5x-]25 
6(x-2)-3(A-2x) - x-12 — > 
6x-12-12"f6x-x+12 - 0 



collecting and Isolating the occurrences of the unknown should have 
signaled trouble Inmedlately, but in all but one of these cases the 

* 

students continued to work for some further steps. In the first case, 
S21 2{^, It appears that the solver lost track of the left-hand side 
of the equation, zero, and Interpreted the purely numerical expression 
obtained when the x's were cancelled as an expression for the answer. 
In the remaining cases the solver abandoned the equations 'hen they 
were simplified.' In the last case no s impl I f I cat Ion was n«^ded after 
the el Imlnatforj of p, and the solver simply proceeded to the next pro- 
blem. • / 

Table ^.6 

^ » 

Working with no unknown 

0- . 3 ■ j^^Q negative 

3-x 3 1 

_2 Q ^ goes into, x goes into that 

> " Y 3 tiroes minus negative two over 

^ three, J 'm destroying this pro- 

blem I think. And just set that 

1." -r- two over three make It two thirds, 

and that's negative eleven over 
three. I don't know how. That's 
what I got," stops 

S20 3B' 7{^x-l) - 3(Ax-l)+i* — > 

7-3(0+4 ^ 

7"3+4 No comment 

7-7 ' . 

S20 5A 5 i')0 

To " ]i+S ^ Comments unlntel 1 ig I ble 

5 _ -10 
% T??- -5 > 

25 - -100 

S20 lA. ^„ £11 

P P 



"That's about as far as It .goes." 



Just as having too^ few unknowns leads to trouble, so does having 
too many. Table 4.7 lists cases in which students proposed solutions 
expressed in">«rms of the unknown. As indicated in the table, in some 
cases there is indication that the solver Is disiatisfied with the so? 
ution, but tht/tablc does flot include cases in which the solver stated 
clearly that the last equation they reached did not give a solution. 
It seems likely that at least some of the solvers f-epresented in the 
table do not clearly grasp the fundamental unacceptabi 1 1 ty of solution 

terms of the unknown; they may be Influenced by the similarity in 
form between these solutions and correct ones. 

Proper handling of equations containing fractional expression re- 
quires an addition to the normal strategy that is not present in the 
Bundy model. It may happen that a number or expression obtained by 
normal manipulation as a root of an equation renders the equation un- 
defined when substituted for the unknown, because of division by zero. 
Such a number or expression is rfct a solution of the equation, since 
it does not make the sides of the equation ^qual when substituted and 
is called an extraneous root. So in sblving equations containing 
division by expressions containing the unknown, it is necessary to verify 
that any putative roots do not create this problem. Table 5,14 shows 
the . equations used in the study for which this issue arises, and the 
subjects whosje solutions Included extraneous^ roots. As can be seen, 
many solvers do not perform the needed check. They may identify the 
goal of obtaining solutions to an equation with the slightly different 
goal of obtaining the resuJts of normal manipulations. 
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Table ^.7 



Solution containing unknown 



SI IB 

I 

S3 lA 

S5 IB 
S13 lA 

513 2D 
S13 IE 



S16 5E 



$18 IB 

522 lA 

523 -28 



A 
prt 



2 



■ P 



/ 



rt 



ac-cbx-ct>-]'» X 

b-x 



3 



X^ 

3 

ix 



A-prt-p 

r . y 



2 ? 
^ . x'' 



"I guess that's simple enough. 
It's not really but that's the 
best I can do." 

"Am I supposed to get that p out 
of there? I don' t know." 

Comments not recorded 

"That's as far as I can go since 
there's no number values for any 
of these variables." 

No comment 

E: "Is there a rule that you can 
give me for knowing when I'm fin- 
ished with the problem, or what?" 

S:"Ok, well there's I can't think 
of any way to get rid of this x 
over here so It would just have to 
be..." tries oth^r manipulations 
which do not get rid of the other 
X "So as soon as you get x on 
one side, that's that's about it." 

E:"lf I could get rid of that shoiJd 
I try to, or what would you say 
about that?" 

S!"Yuh, that's what I try to do at 
at first. To get rid of the x on 
the one side. But I couldn't, 
ccifldn't see." 

"x squared would be one half x. 
I 'm going to leave that as my ans- 
wer". Later: "I had x^. but the 
answer denotes x, so [t would have 
to be half of x^." 

No comment 
No cofiiment 



real dmb answer/' 



. ^1 

I 

The strategy pursued by the Bundy model is largely a direct 
translation of the demands of the solving task. It is necessary to 
eliminate all but one occurrence of the unknown, and It Is necessary 
to Isolate the single remaining occurrence. The nxjdel 's strategy uses 
these necessities to organize the phases of the method. In light of 
this, it Is not surprising to find some agreement between human per- 
formance ^^nd the behavior of the model. It Is more surprising to find 
greater jjgreement in the performance of better solvers, though as noted 
above this Is probably due only partly to differences In strategy Itself 
'between better and poorer solvers, since some contribution is made by 
spurious operators available to^poorer solvers. 

The common departures from the Bundy strategy are interesting. It 
appears that clearing fractions and removal of parcnthesesare Important 
operations. This suggests that human solvers may to some extent use a 
canonical form in the solving process, a form free of fractions and 
parentheses. This could also explain why repeated subexpressions were 
rarely used : they- disappear when-the problem ts canonical tzed. 

Another departfire Is in the handling of quadratics. Unlike the Bundy 
model, it appears that human solvers need at least two strategies, one 
for linear and one for quadratic equations, with a means qf selecting the 
appropriate one. 

The difficulties students have In strategy seem broadly to be what 
one would expect when one al i^,ws flaws In the Bundy scheme, except that 
somt of the flaws seem very fundamental. Jt Is remarkable that some 
students continue to do algebra as usual after the unknown. has vanished, 
and that others propose solutions In terms of the unknown. A lack of 
k/V)wledge of the goal of equation solving Is ImpMcIt In 5uch performance, 
and It would be Interesting to know If exp)lcI^ Instruction would help. 
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CHAPTER 5 ' 

Analysis of Errors 

The Bundy model Is a model of correct performance, but it never- 
theless provides the basis for a theory of errors. Errors would be pro- 
duced if Incorrect operators were placed in the operator store, If cor- 
rect operators were applied where their conditions of ^ipplicability are 
not met, or if the actions called for by an operator were not fully or 
accurately carried out. We present here a tabulation of the errors ex- , 
hibited In the study, separated Into three categories: operator errors, 
applicability errors, and execution errors. Within each category an 
effort has been made to collect errors that share various more particular 
characteristics. * 

i' 
I 

Many errors could be assigned more than one origin. There Is no 
obvious way to distinguish the application of an incorrect operator from 
the Imperfect execution of a correct one, for example, on the basis of 
an isolated occurrence. The reader should therefore attend to the errors 
themselves as much as to ttje classification, treating the classification 
as a suggestion concerning mechanism behind the error that might be ex- 
plored more fully. . Also, the grouping in many cases reveals a pattern 
of similarities among errors that may be 'important In Identifying mecha- 
nisms. 

Operator Errors Table 5-1 show* a collection of errorswhich involve 
the vJeletlon of elements from expressions. Th^^thematlcally valid 
ope rat *^ns^ which these errors apparently .approximate are subtraction from 
both slides of an equation, division of both sides, simplification of quo- 
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Table 5.1 

Op^Y-^tor Errors 



^roup 1 Simplification of quotients 



SI IC . 2kw >2h (k4w) ^, , 

SI IE , X > ax 

a 

SI 10 2x^ - X 2 

—2 ► X -X 

S5 -SB i-x^ 1 

S5 5A x-10 

x+5 * 

S5 5D X I 

2+x ^ T 

S16 5E -x2+(x+3) x2 

S20 5E • ~iwn — * T 

S16 SD Jx . J_ 

2^x2 2^x X 

S20 5A . x-IO -10 

x+5 ^5 ^ 

S20 x-<-3^x ^ x-t-B 

X 

S20 5B • iz2d_4 Ili 

1-x ^ I 

S20 i»C xy+yz+xz ' ^ ^ 

-*-J — ► y + yz +^ z 



a 

S20 1»E^ 2x 2a ^ 2x 2 



5B^ /' i-lj^ ..2^..|..2 



Table 5.1 conttnued 
S20 6C , . iWL_^x2*x.t 

S22 5E ^ x^^^x^^3 2 

x+3 

2 

S16 5B '1-x 2 

1^ > ■ 

S20 60 x42(x 2) . 
Sll 60 """^72 



$20 5B • 1 

T 

55 6D . x+2 ' 

x+2 

S5 , 1A £ 

P 



Group 2 ■ Simplification of quotients with variants of 

deletion operator replace null numerator by 
zftro Instead of 1 

520 5D _x 0 

2+x *^ 2 ■ ... 

If numerator Is null, result Is denominator 

512 be 



51. 1C 



— ♦ "a 

-abc 

replace 5 by 1 when it appears as a term In a 
sum .. 



520 x*3. ^1^.3 



X 



512 1 A p-A - -prt-t ^ p-A - -pr^ 



J-A - -rt 



replace s by 0 when it appears as a factor of 
a product 



k5 



515 IE 

S5 5D 
5A 

516 5B 

521 5A 

S20 7B 
SI i+A 

522 5C 
S5 lA 

Group 3 

51 7 3E 
S20 3B 

r- o 

tERIC„„.. 



Table 5.^1 continued 



i2.-4 0 



treat x as x 



_x 

x-10 

2-2x2 
2-2x 

x-IO 



x-2 



x-2 



subtract s from terms containing it 
12x-2i4 



12 

y 

14-X 



^ x-12 



2+x 



perform deletion only on numerator 

prt rt 

P ' P 

when deleting a power from a term with a lower 
power as a factor, subtr^-ct exponents 



2x' +3 



2x • 'H3 



deletions from both sides of an equation 

2(3-»-x) - Mx+3)-l >x+3-2(x+3)-t 

7(i*x-l)-3(Ax-l)+i« >7-3(l)+A 



a2 ^ b2 ^ x2 
••a - X 

a + + X 



« 2x + 2a 

-X -a 

2 + 2 



^6 



S20 7A 
6A 

S22 IB 

6B 

48 
7B 

f 

S22 6B 
E}.2 

S5 6B 



Table 5-1 continued 
— ^ -X ■ -7 



-2, -2 

2 2 k 7 
X +3x'^f -^->x^+3x-2 

x^- 2x — > x»2 



Comment : "could I subtract 
an X from these ones" 



x+2(x+2(x-»-2) )»x+2 — > x+2(x+2)-0 Comment :"subtract" 
2 



X+3+X » x" — > 3+x « X 
12X x+12 

T2 " ■ " 

x+2 (x-t-2 (x'«'2) )-x+2 — > x+2(x+2)-0 



? 7 
(x+2) (x +4x+4)-x+2 > 0-X +4x^4 



Group 4' 


Deletion 


from one 


side of equation 


S3 lA 


A"p +prt- 


- 

prt 
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S18 IE 


x(a+l)-b- 


— >x"b-a 


-1 


S16 lA 


A"p-t-prt— 


— )(rt)A ' 


- P+P 


$22 6A 


x+2 (x+1 )-4 — >x+l 


- 4(x+2) 


S22 5D 


^4-^2/x)^- 


M - 7- 





Group 5 
S22 48 
SI6 4a 



Subtract Ion 



x2 -X. 



2yz- 
-2y 



E2 7B 6x-j/ -j/^ +6x - x-12 >nx— 12 
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t{ef\^s, and subtract ion » As figure 5.1 shows, all of these correct 
operations do produce' deletions in common situation?. Inspection of 
the errors suggests that students identify these correct operations 
with a single generic deletion operation which often produces in- 
correct results. , The following Is a tentative description of this 
deletion operator and its use. ' 

F igure 5. 1 

V 

Some legal operations producing deletions. 



x+a - b^a ^ X « b 

-a -a 

ax « ab > X « b 



ax . 

> X X ^ a - a y x 



The deletion operator transforms an expression e by deleting a 
specified subexpression s fron It, If the resulting expression has 
operation signs which are missing an operand because of the deletion^ 

i 

these signs are deleted. Similarly, unnecessary parentheses are de- 
leted. If s is a constant and a constant k-c.s appears in e, the 
effect of the deletion of s is to replace k by c\Jij:i e. Figure 5.2 
shows examples of the delation operator in action. 

— ^ The deletion operation is used to simplify quotients when a sub- 
expression s appears in the numerator and denominator, cither explic- 
itly or as a factor of a constant. TKa simplification proceeds by de- 
leting s from the numerator and from the denominator. If the resulting 
numerator and denominator are both nonnull, the result Is their quotient 



Figure 5.2 

Examples of deletions 
delete h from 2kw + 2h'{k-Hv) : 2kw + 2(k+w) 
delete x from x-10 : -10 
delete 5 from -10 : -2 
delete x from l-^i^ : 2+x 

delete 2 from 2+x : x o , 

if the denominator but not the numerator is null, the result Is simply 
the numerator. If the numerator is null, but not the denominator, 
the numerator is replaced by 1 . If both numerator and denominator are 
null, the result is zero. Figure 5-3 shows examples of this process, 
which can produce the first group of errors- In Table 5.1. As shown' in 
Figure 5.4, the procedure also correctly handles some simple; examples . 
Some errors call for variations of the scheme; these are indicated in 
the second part of Table 5,1, 

Figure 5-3 

* Use of deletion to simplify quotieat 

x-10 delete x from numerator; -^.10 

delete x from denominator: 5 

delete 5 from numerator: -2 

delete 5^ from denomlnatoV : 0 

denominator is null, so result Is 
numerator: - 2 
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Figure 5.3 continued 

delpte x fr^oni nun>erator: 8 

, delete x from denominator; 2 x 

delete 2 from numerator: k 

delete 2 from denominator: x 
result: k/x 

X delete x from numerator « 0 

2+x 

delete x from denominator: 2 

\ 

numerator is null, so replace by 1 
result: 1/2 

Figure 5-^ 



Examples for which deletion operation correctly 
".simplifies a quotient 

ax ^ {shows deletion of a and dropping of null 

a ^ denominator) 

X 1 (shows need to replace null numerator by 1) 

ax a 



The same deletion operation may be used to transform an equation, 
if a subexpression s appears on both sides* The procedure Is to delete 
s frqJr^Ach side, replacing the side by 0 if it Is null. The third 
group of errors In Table 5.1 Is produced by this procedure,\whi le the 
fourth group calls for the indicated variations.- As In the case of 
simplification of quotients, this solver does transform some equations 
correctly, as In Figure 5.5. 
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Examples for which deletion operation correctly 
simplifies an equation when applied to both sides 

ax - ay ^ x - y 

X + a « y + a > x + y ■ 

Another case In which deletion may be used arises when a sub- 
expression s is to be removed from one side of an equation, but does 
not appear on the other side. Here s can be deleted from one s^de, 
but must be subtracted from o.' divide) out of the other side. It is 
not clear how the choice of subtraction or division is made in such a 
case. Examples of errors which may arise in this way are shown in 
the fourth group of Table 5'. 1 . Note that the last errors In this group 
involve a multiplication done on the other side rather than a subtrac- 
tion or divi sion. 

The final group of errors in Table 5.1 may r6su'tt from the use of 
deletion to carry out an indicated subtraction within one side of an 
equation. 

Table 5.2 illustrates a constraint on the deletion operator stated 
by one subject. The subject indicated that cancellation could not be 
used to simplify either quotient because the entire denominator did not. 
appear in the numerator, 

t 

^ Table 5.2 ] 
Examples with cancellation blocked 
S5 5E x^-t- (x-t-3) 

S5 5E + 3 

Gn ' 
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Another constraint is- shown in Figure 5.6. Two excerpts from 
the protocols of the same subject are shown, In which the subject 
states that items cannot be cancelled unless they are multiplied. 

Figure 5.6 -j 

i 

Examples of Erroneous Cancellation 

Cancels h's 

^ - 2hik^) ^^^^ something 

cancels and when it doesn't lilce 
that?" 

S: "Ok, if it's in the. if it's in 
the denominator, if it's on the 
. top and bottom. Then ah, and if 
I t's^'-flH^tipl ied, if it's added you 
cai/t doSi^ Like if I had a w 
there (points to second w) and a ^ 
w down here (points to denominator) 
^ I couldn't cancel that w out 

(points to second w) but I could 
cancel that one (points to just w)" 

E: "OK" 

S: "Because that's multiplied and not 
added." 

SI 60 2 S: "Well, if } treat this as one unit 

^+2 right here (points to second x+2 

and puts parentheses around denom- 
inator) I could -ancel this out 
; € ' ' (points to secono x+2 and denom- 

^ inator) because that's one unit 

(points to second x+2) that's be- 
ing multiplied by another unit 
(points to first x+2) right there. 
(Puts parentheses around first 
x+2.) Since they're all the same 
' you can do that, I guess, and then 

, ' that would still apply to my rule, 

• • you know, you've got to be multl- 

V, ' ' plying." 

' ' o 

.This restriction avoids many sinlple errors, like transforming (x+a)/a 

to X, but this may actualtly unfortunat|, since It makes the Invalidity 

■ . - \ i 

of the operator, If ss I Ike I y to be spotted. It Is Interesting that this 



constrained operator is quite a reasonable guess at an operator that 
transforms ax/a- to x but does not transform (x4-a)/a to x, and illus- 
trates what might happen in lea'^ning from a few examples. 
Transposition errors Table 5*3 shows some errors, all from one sub- 
ject, that Involve an erroneous operation in moving elements from one 
,side of an equation tc another but seem not to involve the deletion 
operator. In the first three examples a term is subtracted from the 
side of\the equation where it Is found, thus deleting it, and is added 
to thf- otheT^ side. The last example, Problem 7B, follows this pattern' 
in tho handling of the term x, but not In the handling of -24. 

/ . • 

Table 5.3 

♦ * 

Transposition errors 
/ • 

S16 3B 2^'- 11 - 12x - 3 ) kOx ' 

S16 6b 7x + 8 - X 2 ► ' 

. r 

+x -X 
8x+8 - 2 

S\e 3A 9x+360 - 5X+200 > 9x+5x - 360+200 

516 7B I2x-2i4 - x-12 > 1 2x + x - 2^4 + -12 

Recombination operations Table 5.^ shows errors involving the re- 
combination of elements of two or more terms. These errors may arise 
from an Interpretation of addition and multiplication In which both 
represent a generic combining operation. For examplf, x+x, 2x, x-x, 
and x^ n«y be thought of as combination of two x's. Since many 
different expressions are given the same interpretation in this way, it 



Table 5.^ 

* y 

Recombination errors 

+ X + 3 >x3 + 3 

-3x^ + 3x^ — ^-3x 

y ^ yz ^ 2yz 

p+p — ^ 

2x + x^— ^3x2 

x2 + (x+3) ^ ^ 2x2 + 3 

"X is one half of x^*' 

ax + bx + ab ^ 3^+ b^ + x^ 

ky + yz » x+2yz ^ xz + 2y 

xy + yz + xz ►x^yz > x^ 2yz 

bcx + acx + abx + abc > 3 abc + 3x 

ax ■♦- bx' + ab > 2a + 2b + 2x 



is possible to rearrange the elements of an expression quite freely 
without changing its Interpretation, Figure 5.7 shows how some of the 

IT* 

errors in Table S can be produced. 

Figure 5.7 

Recombination of elements of expressions 
x^ + X + 3 >"two x's" and "one x" and "three" 



S5 


5E 


S5 


5E 


S16 




S16 


lA 


S16 


kB 


S16 


5E 


S16 


5E 


S16 




S22 


kA 


S22 




S22 




S22 





-¥ "three x's" and "three" 
X? + 3 



y + yz > "one y" and "one y" and "one z" 

> "two y's" and "one z" 

» 2y2 
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Two subjects mentioned restrictions on the possible recombinations; 
rearranging ax bx ^ ab as a^ + b^ x^, the subject not^d, '^Ok 
wi^^t; you^re doing here is you're multiplying all three of these things 
together; the a to the x, the b' to the x, the' a to the b. So It's a 
case of multiplication not a case. of addition. An x plus an x would be 
an X squared instead of x + x, and a times^ an a would be an a squared, ^ 
and a b times a b would be a b squared. But if this was a plus In here 
(writes plus between b and x in original expression) instead of multi- 
plication then you couldn^t do this.** The suggestion m^y be that elements 
which are recombined into products should have appeared in products in 
the original expression. Another subject^ asked to explain a, similar 
^recombination, said "1 don't really know the rules. It makes it easier ^ 
if you combine everything that's the same. You have^ like, the same 
thing if you^re working with numbers and you have 1,1 J it's just 
easier to say three, The same subject had rearranged ax bx + ab a$ 
2a 4" 2b ^ 2x, The response .was , "No, cause here you're multiplying. 
2ab is the same as 2 times a times b and here lt*s all addition." If 
the subject means by "here" the rearranged expression 2a + 2b 2x„rather 
than the original expression, this may reflect the same constraint on 
products described by the subject above. The subject went on, '*No, it's 
not anyway. It just makes it easier to keep them separate.*' In the 
context of the problem, the term 2a could be cancelled at the next step, 
so the subject's preference for one rearrangement over another may be 
based on that. 

Co<iibInfng Fractions Table 5.5 shows errors arising in adding or multi- 
plying fractional expressions. Most of the operators apparently employed 



Table 5.5 



Errors In combining fractions 

S! 6C i + ^il x-t-x^-l 

, 1 2 2 

Si^ 5D (^+2/x) 



S22 2C 



( y\ . 4(_x(2Vx)^-2(2-Hx>(x^) 

^ — x(2+x) - 



SI6 7E 7 _ x+I i 7"X43 

T X ' l-x 



1 



X 



S22 2D \ k + J b 

^ 1 c ^ c 



7 3-x-^ 3-x 



2B i+l^i V 3 

X y 2 x+y+2 

S22 2B 1 + 1+1 ^ 1 



xyz 



520 2A 1-1 '0 

521 3 7 ^ 2T 



involve suboperat ions and patterns of operations that are seen in 
correct operations on fractions. These e1en>ents are shown In Figure 
5.8, which also shows how they can be incorrectly ass^jubled to form 
operators that produce sone of the errors in the Table. In one case, 
a student who combined 4/1 2/x to obtain 8/x said that the operation 
Involved was "multiplication of fractions", and said that It was only 
appropriate when fractions were to be added. Here the entire correct 
operation for multiplication Is carried over for use In addition. 



Figure S.8 



Elements of correct oper^rions on fractions 

£4 £ ^ ^"^^^ common 4- ^ > sum of numef^ators ^ ad-^-bc 

b d . denominator bd bd - denominator " bd 



a c 



V product of numerators 



b d product of denominators 



Note that this is a component-wl se operations; the. indicated operat ion 
is performed separately In numerator and denominator. 

How these eljcments niay be combined to give errors. 

^ ^ ^ sum of numerators 

1 2 product of denominators 2 



^ form common U(x(2-hx)) ^ 2(2^-x) \ \ 

deno^ninator , \ x(2+x) x(2+x)j \^x(2tx) j 

V co mbination of. numerator under Indicated operations 



denominator 

(Mx(2H-x))^2(2-^x))(x^) 
x{2+x) 

— - > component-wise subtraction * \ 

1 X ' l-x 

^ 4 2^ ^ product of numerator 1 ^ 8 



^ product of nume rator 1 



product of denominator x 



A possible related family of errors 'Is shown in Table 5.6. These 
may be seen as the result of inverting the component~wl se addition of 
fractiops^seen in some examples in Table 5.5. 

Table 5-7 shows two errors from one subject which may be related 
to the errors in combining fractions just discussed. In each the sub- 
ject inverts one fraction of a sum. This operation may be based on the 
inversion used In the common method of dividing fractions. This inter- 
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Table 5.6 



S16 5C 

520 5C 

521 5C 

7^ 



S2i 2C 



S22 5B 



Errors In decooipos 1 1 i on of quotients 
2 



11^' 
1+x 

1-x 

-2-3x 
3-x ' 

1-x2 



3j 


+ 


1x2 


1 1 




X 



-X 



3 



■41-x 



. 3 



Comment "negative x Into neg- 
ative X gives positive' 



X' 



prctation, is supported by the fact that the second rearrangement was In 
fact transformed tp x/7, which is the product of the two fractions after 
inversion. This follows the division procedure, except that the second 
fraction would be the one inverted if the Tiot^ion a/b -r c/d were used. 

"Table 5 J 



S22 2A 



nversion errors 
1 



X 7 



1^1 



X 1 



^ 1 7 



Cross-mul tipl l.catlon The correct cross-mul tipticatlcn operation trans- 
forms an equation of the form ^/b - c/d Into ad <• be. Errors Involving 
this operation are shosvn In Table 5.8, It appears that the operation Is 
sometimes used , on an equation but altered to produce a fraction as a re- 
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Table 5.8 



Errors Involving cross mu) t li^l I cat I on 



SI 5A • I . x-\Q i '<15 

2 x+5 ^ 2(x-10) 

SI 5B l-x2 ,2 , 1-x 2 



l-x ■ 1 ^ 2-2x 

* 

S5 2C 22 ^ f 



7 3-x 



> 66 - 22x - kS 



^5 2D / J \ /a \ 1 tomments: says Is cross 

^b^i jlv 3(b4j^J multiplication 

$5 SC x^l ( 1 • ' comments: begins to cross 

\. / multiply and 

writes 2x4-2 «• 
before remarking 
^ 'can't have two 
^ equal signs'' 

X 7 

S) 2A J_ ^ I X 

X 7 ^ y 



S20 6E X , ^ ^2, . .8 -6 

I X 



• ■ s 

suit, perhaps by analogy to other operations on pairs of fractions, and 
may also be applied to a sum> difference^ or product of fractions rather 
than to an equation, egain by analogy to other operations on pairs of 
fractions. In both si tuatlons, the cross-multiplication operation yields 
two terms, ad and bc^ which must be used to^^orm resiJlt, so one 
might be used as numerator and the other as denominator as in SI 2A and 
S5 2D, or they might be combined using the Indicated operation on the 
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original pair of fractions, as in S5 2C and ISI 2A. Even when the oper- 
ation is used correctly to transform an equation to an equation trouble 
is possible If the conditions of application are too loose, as shown In 
the last example in the table. 

Errors S5 2C and SI 2A are examples of what Matz (1979b) has called 
the "Lost Common Denominator Bug." We include them here because, as 
indicated abo a, they could result from the adaptation of cross multi- 
plication as an t^peration that combines pairs of fractions. Case S5 6C 
seems to indicate this possibility quite clearly, since the solver was 
using the cross multiplication operator on two fractions that were multi- 
plied, and stopped when the operator generated an extra equals sign. In 
the earlier case S5 2D the cross multiplication was completed. 

Matz attributes this error to partial execution of the addition of 
fractions operation. Our analysis of course does not mean that Matz is 
wrong, since the same surface form can have many origins. Our analysis 
does, however, complicate efforts to pin down the origins. Specifically, 
Matz suggests that a reduced incidence of the error when adding numeri- 
cal fractions would favor the partial execution explanation because the 
processing load would be reduced for this simpler problem. But subjects 
have probably never applied cross-multiplication to purely numeric exam- 
ples^ so the frequency of erroneous use of cross-multiplication would 
also presumably be less. 

Splitting equations with fractions Table 5*9 shows the use of an oper- 
ator which splits an aquation with fractions Into art equation in which 
the nu!ierators are set equal and one In which the denominators are set 
equal. This splitting Is occasionally va^Jid^ as In the case of the equa- 
tion x/(x^l) - 2/3^ but In general It Is not, since the two equations In 
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general do not have the s^e solution. This use of this operator 1$ 
discussed below, where it Is argued that It reflects an eccentric view 
of how equat ion sol V i ng works^ In which It assumed that a solution can 
be obtained by trying to make the sides of the equation match, rather 
than by the usual manipulations,. 

Tab'le 5-9 



Splitting equations with fractions 

S16 5A 5_ x-10 5-x-lO 

10 * x+5 ^ lO-x+5 

5E 2x^-^3 X ^ 2x£+>x 

3x^9 " 3 ^ 3X+9-3 

2x+3 , V ^ ^ , 
— ^ * 1 > 2x+3»l 

x^ 

SIO 5A 5 ^ x-10 5-X-10 

"7i 



Sl6 5B 1 -x^ 2 2 



10 x+5 MO-x+5 
>x^ 



1-x 1 



The reciprocal operation Table 5-10 shows errors resulting when the 
reciprocal of a sum is taken improperly. In each case, the error reflects 
an assumption that the function f(x) - 1/x is linear^ so that l/{a+b) « 
1/a + !/b. This sort of assumpt ion. has been noted by Matz (1979b) in 
connection with this and other functions, Including square-root* 
n j vision by zero (f an equation Is transformed by dividing both sides 
by an expression whose value is zero an inequlvalent equation may result. 
Neglect of this condition on division may result in losing solutions, 



Table 5.10 



Errors In forming reciprocals 
28 i.i^J »_!_ 



X y z x+y+z 

S5 2D has 1 u . . . 

^-y « expr but drops the 1/ , 

getting x - expr -1. Corrects this to 

I 

^ ■ expr -1 

SIO 2B 1 1 1 ^ 1 _ 

SI 1 2B R ' y ' z *■ X 

1 - -a -b -c >x . - 1_ i„i 

X a b c 



4 R-y-z-x 



1 . _ i . 1 _ 1 

x a b c 

S22 2A notes 1 1 1 

3 ^ 7 



as Illustraced in the first group of errors in Table 5.11. Thus the 
division operator should carry with It actions besides the division 
itself to provide for detecting any lost roots. One way to do this 
'would be to create two new equations rather than one: a - b produces 
a/s - b/s or s 0. The final error shown in the first group is a 
subtle one perhaps stemming from such an elaborated division operation. 
The subject may have derived a/s ■ b or s « 0 from a/s - b^ whence 
it does not follow. This is because if division by s is indicated in 
an expression^ s cannot be zero If the expression is to be defined* 

Group 2 of Table 5.11 shows subjects who lost roots on the equa- 
tion 2x - X f but not by division. These subjects simply noted that 2 
was a root, but failed to notice the other root. 
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Group 



Table 5.11 
Loss of roots 



Division by zero 



IB 

E*^ , E6 , E 1 0 
Ell, £13 
S7,SIO.S13 
S19. 

3A. 

E3,E6,E9, 
£10, El 1 .519 

S13 3A 



Group 2 



2x-x' 



-> 2-x 



(zero is a 1 so a root ) 

9(x+40) -5 (x+40) >9-5 

(-^0 is a root) 



Solution by inspection 



ComfTient: '^cancel these, 
1 -X by Nx. If 1 -X 
is equal to zero, and 
x-1 , And the other 
answer would be. . 



IB 

E7,S12,S20 



2x«x^ 



2-x 



Splitting factored quadratic equations Table 5^12 shows two errors^ 
from one subjejct^ in which the operations for solving a quadratic equa- 
tion by factoring are closely followr'. In the key step shown, however, 
the studenr splits the equation into tVK> without having first placed 
it in the form expr « 0, The splitting operation, as used by this sub- 
ject, lacks an essential cheese on its application. 

Square root Table 5^13 shows some errors associated solving equations 
2 

of the form x - expr. The last two examples may simply reflect a choice 
of only one root^ and so may belong with ss of root errors just 



discussed, but they may also be related to the puziling error of the 
same subject on Problem 5B- 

Table 5.12 

Splitting quadratic not equal^o zero 

S7 5B x(x-2) — 2 X -"-2 or x-2 - -2 

S7 hB x(x-2)-3 } X - 3 or x-2 - 3 



Table 5.13 



Errors associated with square root 
S19 .IB 2x - x^ ^ 2-x > ±2-x comments: "but this' 



S16 5B x^ - 2 >answer is -1 

SI 6 ^B x2 - 1 ^"x - -1 

S16 3x^ - 3 >x - -j 



squared so it cofjj-il be 
plus or minu; 




Extraneous roots It may happen that a number or expression obtained 
by normal manipulation as-a root of an equation renders the equation 
-undefined when substituted for the unknown, because of division by zero. 
Such a number or expression Is not a solution of the equation, since It 
does not make the sides of the equation equal when substituted and so is 
called an extraneous root. So In sol vlng equations involving division by 
expressions containing the unknown^ it is necessary to verify that any 
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putative roots do not create this problem. Table 5.14 shows the prob- 
lems used In the study for which this issue arises, and the subjects 
whose solutions Included extraneous roots. As can be seen, the false/ 
assumption that the results of algebraic manipulations are always 
solutions is widely held. Subjects may identify the goal of obfaining 
solutions to an equat ion' wi th the slightly different goal of obtaining, 
the results of normal manipulations. 

Table 5.14 
Extraneous roots 



extraneous root « 1 



5B ' . 1-x ^ 

E1,E5,E6 1-x 

E12,E13,EU 

S6,S10,S1 1 

S12,S15,S19 



SIO 5- (^+2/x) (-^iH * extraneous root « 0 



l2+x/ 



Arithmetic errors T^le 5.15 shows errors which seem to involve simply 
incorrect arithmetic on unsigned tubers. 



Table 5.15 

t 

Arithmetic errors * 
S15 3B '^eleven minus three nine 



1 1 



S2l 3B 7(l<x-l)— > 21x-7 

4 



55 2E (2) - 37 — >6.5 • multiplying 



operator. g .: OS Just as Invalid ope/ators might be Included In the 
operator store in the Bundy model, so might valid operators be missing. 
As would be expected from this, some solvers see'm to lack certain oper- 
ators, and so' have trouble when they reach a point In a solution where 
such an operator Is needed. Table 5.16 collects cases in which solvers 
abandoned work on a problem or backtracked to an earlier point In their 
solution, when a legal operator exists that would have permitted pro- 
gress towards solution. In these cases It Is plattsJble that the solver 
lacks the needed operator^ though it is also quite possible that the 
solver kncLs the operation and actually considered using. It but decided 
not to. Where this latter possiblMty is suggested by the solver's 
comments the case is not Included in the Table. 

The cases in the table are grouped according to the operator that 
is not used. The flrrt group involve the inversion operator: the solver 
transforms the equation to the form 1/x - expr, where expr is free of x, 
but cannot finish the job by putting x - l/expr. Actually, the lack of 
this operator probably is more cpmmon than these examples show, because 
only cases in which thX solver found no operator to use are Included. 
Some subjects transformed l/x - expr to 1 - expr to x - l/expr, and it 
is likely that ^ome of these did not have the Inversion operator avail- 
able. . I 

The second group of cases Involve other expression: with x in the 
denominator. Here Is seems unlikely that the solvers do not possess the 
needed operator, multiplying both sides by the denominator, but rather 
that they 'do not use It. Such -dl f f I cul t les could be described in the 
Bundy framework as Improper labeling of operators: the multiplication 
operation needed might not be marked as useful for Isolation or attrac- 
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Table 5.16 



Operator gaps 



Group 1 



nvers ion 



S6 2B 
SI2 2B 
S21 2A 
S23 2B 

* 

Group 2 
SI its 



X 
X 

12, 

21 



•yz-t-f^z+Ry 
Ryz 



1^1 

y 2 



X 



1 

R 



1 « 1 - 1 - 1 

X R V 

Other cases with x In denominator 
2x+3 



SI 28 



S16 28 



S21 58 



^B 



1 



x+y+z 



R 

1-x 



3 



x+y+z 



not attempted 



not atteinpted 



2B 



1 . 1 ^ 1 ^ I 
R X y z 



not attempted 



Group 3 
S3 1A 

S5 lA 
S5 lA 



Dead ends 

A. . p 

prt 

p - £H 

'P ■ -A+prt 
•p-» -A^prt 



solving for p in A'^p-^prt 
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S6 lA 
.S!0 lA 
S13 lA 

S16 JA 
S21 lA 



Table 5. 16 continued 

A-p(rt) 
A -prt - p 

^ - p 

rt 

rt(A) - p2 
-p-prt-A 



Group k 
S3 2B 



.Sl-5 2B 

Group 5 
S3 5A 
S3 4b 
S5 7A 
S)5 IB 
S20 7A 
S20 6A 

S22 7A 
S22 6B 
S20 6B 



Collecting terms 

xyz ^ Ryz ^ Rxz ^ Rxy 
Rxyz Rxyz Rxyz Rxyz 



xyz - xzp - xyp - 

Quadrat Ics 

50x (x-20) » 6250 

x2 (2x+2) - x2 

-X -16 - 0 
C - x2-2x 

x^-x " 7 

2 2 
x'-'^x - ^ 

2 

X -X 



pyz 



Comment: "That's all you 
can do to that . You 
can't add them'. None 
of them are a1 ike," 

Comment: "I don't really 
see how you can reduce 
that anymore." 



-2-14 

X"^2(x-f2(x"»-2))-K-»-2 — >x*2'.x+2)-0 (step* spoken, not written) 

X"^2(x"^2(x-»-2)) - x+2 — > ... — ^ Comment: "I can factor this 

back down ^ut that 
x2+i»x+A - 1 wouldn't JO me much good' 
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Table 5. 16 continued 

Group 6 Other gaps 

Comments: *m not sure how 
to get rid of a nega- 
tive exponent so I 
won't try/' ^ 

Unable to factor to get 
constant term zero 

tion. !n f act » the mu 1 1 1 p 1 i cat i on ; needed in t!ie f i rs t case In the group 
is not marked useful for attraction in Bundy^s tentative list of oper- 
ations: perhaps human solvers have the same lack. 

Group 3 collects dead ends reached by solvers on a single problem in 
which the key step is transforming p > prt to p{l^rt). As can be seen, 
this step was difficult for many solvers. Some never succeeded, and 
others succeeded only after considerable exploration. Two interesting 
solutions are shown in Figure 5,9, As with the multiplication operation 
discussed above it is doubtful how many solvers really lack this factor- 
ing operation. The difficulty may be in perceiving that it is applicable 
to a sum of terms in which one has only one explicit factor: 1 must be 
seen as an implicit factor for the ordinary inverse of distribution to 
be appl ied , 

Group k shows a few cases in which solvers were unable to collect 
terms, The conments suggest that the solver may have been looking for 
a common factor of all the terms^ and failed to consider combining on'y 
a .^ubset'of the terms, as Is actually needed. 

Group 5 strow^^ciuadrat I c equations abandoned by solvers. It does 
not Include Coses In which factorization or use of the quadratic formula 



S5 2 x^"2 4-3 



S6 IB x'^-2x » 0 



Figure 5.9 



Two solutions for p in 
-p « --A+prt 

/ 

A-p*prt 
A«p+prt 

A-p(rt) 
A-p^-prt 



A«p+prt 

A . £ ^ Pit 

P P P 




1 - ^-^ft 
P A 

p+prt-A 



A 

P ' -l+rt ^ 



A-p-^prt 



S;**You want to get this p 
(points to second p In. 
second equation) over there 
(points to -p) somehow but 
this A doesn't have p in It. 
what you might do is go 
' ahead and leave this A over 

wr I tcs 3rd 1 I ne 
**anci you Ml have prt'so that 
way you can divide. ' No, that 
still won't work.** \ 

rewrites orlginaf problem 
*'0h how dumb, A »• ok go ahead 
and factor out this; p here 
while It's on this /side since 
they both have p's in them 
and you have p timis It, oh 
wait a minute that.'s wrong** 

rewrites original problem 
**0K you want to cancel out 
this p so when yoU do you'll 
have a one left hfcre'^ solves 

\ 

S:*'lf you divide both sides by 
p you^d get p over p leaving 
A over p equal to 1-i^rt. Then 
dividing both s^des by A". 

add 1/A to both sides 
**would give you one over p 
woulii be equal to one plus rt 
over A, Urn, distressing, I'm 
going to cross ^mul tiply, would 
give you p tlmesl plus prt, 
what I originally had, make 
that equal to A. But this is 
factored now into these two 
components and if I just want 
the p divide by one plus rt/ 
divide both sides by that and 
that would give p equal to A' 
over one plus rt* 



was unsuccessfully attempted, but only those In which there was no 
Indication of a next step. A partial exception Is the last one. The 



to zero" part of the procedure of solution by factorization and that 
if solution by factorization were available at all it would have been 
used before multiplying out', when the equation was in factored f^m, 
except for the zero. Also, factorization was not attempted by this 
solver in two other cases included in the group. 

App] Icabi I i ty errors Errors can result if a correct operation is 

applied to an expression or equation that does not satisfy Its con- 

ditlons of application. This could result from faulty checking of 

th^e conditions, or from Improperly interpreting the syntax of an 

expression. or equation. Table 5. 17 shows some errors that may arise 

in this^way. The first group Involves treating a quantity^a"^ if It 

were parenthesized, either in a division operation or a multiplication. 

Note that often a subject misanalyzed only one part of an expression ^ 

when two analogous parts were present. In the expressions shown with 
ft 

2 parts, one misanalysis allows a cancellation and another forces 
distribution of a binomial. Of these, the first is much more conimon , 
suggesting that the error may not arise from misinterpretation of syntax 
but from use of an Incorrect deletion operation, In these cases. 

The second group of errors In Table 5-17, all from a single subject, 
Involve the Interpretation of fractions In which x appears as a factor 
of the denominator. Aslced to explain operations which transformed 2(l/2x) 





S20 



Table 5.17 
Appl Icabl 1 1 ty errors 
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Group 1 Misinterpretation of grouping 



El. Ell 

S6.S18' x+2{x+2{x+2))-x+2 — > x+2(x+2)-l — >x+2x+^-l 

■ 6B 

# 

"S5 6B x+2(x+2(x+2)) >(x+2) (x2+i*x+i<) 

S8 6B * x+2(x+6) >(x+2)(x+6) 

S!2 x+2(x+2{x+2) )-x+2 > x+2 (x^+l^x+'i*) - x+2 

^ S20 68 

i y ^x2+l4x+J^«l 4 

sn 6B x+2(3x+4) - x+2 ^3x+^-l 

S5, S6 'x+2 (x+1) — > x2+3x+2 
S11,S20 

■ 6A 

'S22 6A • .u+1) >x^+3x + 3 

sn 6C x+1 ^x+l_y_^ x^+2x+l 



2 



S20 6E (3+x)3+x >9+^x+x2 



b5 7A x-2(x+l) >x^-x-2 

S22. 



S20 7A x-2 (x+1) >x^+x-2x-2\ . 

S6 7C x-2(x-2(x-2)) - x-2 >x-2(x-2)-'l >x-2x+i4-l 

S13 



Group 2 

S5 2A 21 ^ _U 

21x 1 
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Table 5J7 continued 
^5 2E 2 ^-L^ — S: "not sure whether this 



•X stands for one half x' 



■4 2x 



X 



Group 3 ■ • ' 

S3 3C • -120+7 > -127 

Group k 

£4 6B x>2x+l( - 0— )x- -2±1^-(M(M 

2 



to X, the subject said, 'm not sure whether thi§ x stands for iy2x 
or whether It's one over 2x but I think that does not make a dlfferencfil^ 
I think X applies to the whole tern before it." The next group of 
errors in the table may arise from the application of a s\jbtractJon 
operation to a part of an expression that is not a subexpression of 
the expression. 

• The final error in the table may result either from a misinter- 
pretation of the syntax or from incomplete checking of Conditions 
for the operator that applies the quadratic formula. 

Table 5.18 shows two cases In whl c+T^T's interpretation of paren- 
thesesjs not implicit In a multiplication or division operation but 
is m^de explicit by insertion of parentheses. 

Table 5-18 
Errors fn grouping i 
SS 6B x+2 U^Z (x^2 ) ) > (x^2) {x^2 (x+2) ) 

SI 6D x-t-2(x+2) » (x42){x-f2) 

x+2 
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Execution errors The errors in Table 5.19 may result from incomplete 
execution of correct operation. In each case, the possibility exists 
that it results instead from the complete execution of an incorrect 



operat ion 



Table 5.-19 



Partial Execution 



Group 1 



SI 6A . 
SI 6B 
Si . 7A ' . 
S16 5D 

SI6 70 
S2I $0 • 

£6 68 
El^ 5A 



D i"^tribution 



2(x+l)^ — >'2x+1. 
2(x+2)— >2x+2 



2(x+l)--^ -2x-l 

X ^ . 8x 

2 T^y ^ 2^ 

(x+l) (x-2) — > ->?-'l 




2x 



X l2+xy 



2+x 



;:+2(x+2(x+2) ) >x+2x+4x+i+ 

1 _ x-!0 



x+5 



-) x+5 - 2X-10 



Group ,', 

£1 ^rB ^ 

E2 

' E12 i|B 

S12 2A 

S15 4A 

/"S22 2C ■ 



J 



Errors in setting sign in transposing 
2xV>x2— ^0- x2-2x+3 

1- ' + 1^1- ll+ 1 
3 r 7 X 3 7 

xy+yz - 2y — >xy - 2y+yz 

22-^,1 v22_,l ^ V 

7 3-x 7 ^7 7 3-x 



ERIC 



S3 
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S22 2E 
S22 5A 



Table 5.19 continued 
6 1 + 7 - 0 >6 1 - 7 ■ 

X X 

5x + 25 - lOx - 100 — ^5x - lOx - 75 



ck 5B 

E6 7A 
E7 

E!0 56 



Group 2 


In arithmetic operations or -'gned quantities 


£2 5B 


2~2x-l+x^ >x^-2x-1 


S7 3E 


+ 12-1 — > -11 


SI 5 5C 


x^-2x+3-2 — x^>2x-I»0 


S18 3A 


4x- -160 ^x*^0 


S13 38 


28x-7 - 12x-3+^ — 5- 16x+it-i4-0 


S15 7A 
S16 


-2(x+l) >-2x+2 



n other operations 



1-x' 



(x+l)(x-I) 



-;i-l6 — >x«16 

^ -(x+1) (x-1) 



(x^-l) 



X- 



Group 3 
S16 2B 



S23 

S17 28 



Other operations 
3 



r 

X 

7 



x+y+z 
3 



> (x) 1 



x+y+z 
3(^)+2(2) 



r x+y+z 



S: "So that would be 12 + 2 
which Is 1^" 



^ ^ ^ y ^ ^ to isolate X 



The first group of errors In the table involve distribution, in 
which a needed product is not formed. The second group consists of 
errors in which only the sign attached to a result is incorrect. 
These may result frooi incomplete execution of operations in which 
the determination of sign is a final step, as in multiplication of 
signed quantities. 

Factoring Table 5-20 shows Incorrect factorizations, in each case 

factorization is ruch that at least the term of the product Is 

/ 

correctly generated, !n the first -eyid last examples the x term Is 
also correctly formed. In the fo;,'rth e^^ple, both terms of the 
desired product is generatedy-^s^jf there are unwanted x terms. In 
view of these facts, it is possible that these errors occur through 
Incomplete checking of the product. I f checking Is regarded as part 
of a complex factorization operator, these errors would arise from 
Incomplete execution. 

Table 5.20 

Errors in factoring 

S13 ID 2x^-x-3 >2(x+])(x-2) 

S22 5C 3+x2 >(3-»-x)x 

SI ID x^-x ^x(x-x) 

S22 5C 3-^x2 ^(3^.x)(Ux) 

El x^-2x+3 — >(x-3)(x-»-l) 

* 

Part of the process of applying most operators is replacing part 
of an equation by a transformed, usually equivalent^ P^rt.^ In the 
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Bundy system, using a tree representat ton for expression, subexpres- 
sions can be replaced dj^rectly by equivalent ones. The replacement 
problem, is more complicated in the li neai^-^nj^at Ion in coiwon us^. The 
error In Table 5.2' shows what happens when the subexpression ((x+3)/x)x 
resulting from multipWing both sides of the equation by x, 15 replaced 
by the equivalent subexpression x + 3. The rules of syntax require 
that the replacement be enclosed in parentheses in this context-, though 

is 

not in other contexts. 



Table 5.21 

Repl acement . 
S6 7E . iiLl = ^2 — } -x+3 « -2x 



So/ne other errors which seem to reflect difficulties in actually 
carrying out what might be correct operations applied appropriately, 
are shown in Table 5-22. These are quite diverse, and so the table 
contains comments on each. The grouping In the table separates errors 
associated with the writing or reading process, those related to mix- 
ing of operation, and others. 

The mixing of operations group includes two errors arising in 

clearing the denominator of one or more fractions. Note that in each 

case the fraction was multiplied by the denominator, the denominator 

# 

is eliminated, but the numerator is also multiplied. It is plausible 
that this represents a mixture of the operation of clearing the denomin- 
ator and the operation of multiplying numerator and denominator by the 
same r mber (Richard Young, personal communication). It is not evident 



so 
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Table S.22 



Fa i 1 ures of Contro 1 



Group 



SIS 70 

E9 3B 
Ell 6B 

S8 6b 
S22 3B 
'S23 7B 

S3 



Errors related to writing or reading 



(x-»-l)(x-2) >(-x ;i)(x-2) 

> -x2-3x-2 



7(i4x-l)-3(^x-l)+4 >7y-3y+l Introducing variable for 

x\2 ( x+2 (x+2 ) ) «x^ — > (x+2x+4 ) »0 
1 



x+2(x+2) — >x+2+^ 

}{kx-])-^k >12-3+^ 

6(x-2)-3(^-2x)-x-12. > 

6x-l2+(-12+6x) - x-2 

^2 i^_^2x3 + 2x2 



says "two x" 
says "twelve x" 



Group 2 
S3 ^B 



S8 2A 



S20 6C 



Group 3 
S3 2B 



Mixing of operations 



7 2x+3 



2x3 2x' 



1 1 



X +2x+l 



A Z_ 3 2i 
21 '21" X 



-^2x2'^^x+2«2 



Other 
i - 1 

xyz ^ Ryy^ ^ Rx2 ^ Rxy 
Rxyz Rxyz Rxyz Rxyz 



4 



Clearing denominator and 
multiplying numerator and 
denominator by same quan- 
/ity . 

forming common d-5nomfnator 
and multiplying through 

clearing denominator and 
multiplying numerator and 
denominator by same quan- 
tlty^ 



- o 

.ERIC 



Q 'N 
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El 6A 
C7 7B 
S22 2E 



S22 6A 
S8 2C 

S7 5B 



Table 5-22 continued 
3x-2 >xi«3/2 

llx-12— )l/]2 " . 



3- 



6l ^ ^ 

X 



corrected to 7 



x+2(x+]) >x^ -♦^3x-*^3 



22 . 
7 

1-2- 



3-x 7 3-x 



■23 



Con>nient:^'mul tiply that 
(points to 2) t Imes 
that (points to 3) ^nd 
add that (points to 
numerator) to it, so 
It would be 2 times 3 
times that (points to 
numerator) is 6x + 6** 
*^2 times 3 plus 7 
(changes 6) 2 times 3 
plus 1" 




whether this mixture ^nould be thought of as an incorrect operator, 
possessed by a subject as a stable entity, or whether it results 
from a control failure during execution of what might be separate, 
more-or-less correct operators- One subject, when asked to explain 
the operation did not do so but proposed an alternate method. 
Error Summary Table 5*23 shows the overall frequency of occurrance 
ofall the types of errors found, excluding the fol low-up problems 
for the selected group. Frequencies for the session 1 problems alone, 
which wer:^ presented to all students, are shown in Table 5.2^, for 
the top, middle, and bottom groups of solvers- There Is a suggestion 
of a shift in the prevalence of the error types as accuracy Increases, 
with execution errors relatively more frequent and operator errors less 



Table 5.23 
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Error frequencies, excluding follow up 
problems for,, selected groups 




i 



■ Category 
OPERATOR ERRORS 
De let f on 
Transpos 1 1 i on 
Recdhib I na t J on 
Combini ng f ract ions ' 
De^composJ 1 1 on of quotients 
Inversion 1^ 
Cross mul tlplfcatlon 
Splitting equations with fractions 
Reciprocals 

Loss of roots , 

Splitting quadratic not equal to zero 

Square root 

Ar i thmet i c 

APPllCABiLITY ERRORS 
Appl i cab i 1 i ty 
Grouping 

EXECUTION ERRORS 

1 

Fat'tial execution 

Factoring 

Re^ axemen t 

Failures of control i 



Frequency 

60 
k 
12 

> 

10 
6 
2 
8 
5 

20 
2 
k 
3 

29 
2 

30 
5 
1 

17 



TOTAL 



227 



V 
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Table 5.2^ 

Number of errors and percentage of errors by 
aLcurac^ of solvers for Session 1 



Category 

OPERATIONAL ERRORS 



Top 10 
Solvers 



Middle 
Sol vers 



Bottom 10 
So 1 vers 



De 1 6t i on 






C 119 

J 1 1 6 


■3 1 

3 1 


35% 


Transpos i t ion 




- 




• k 


k% 


Recomb i na 1 1 on. 








k 


k% 


Comt? i n i ng f rac t ions 








3 


3% 


Decomposition of quotients 








1 


]% 


Inversion 








2 


n 


Cross mul t ip! teat ion 








i+ 


h% 


Spl i tt ing equat ions 

with fractions 
Rec iproca 1 s 






1 2^ 

2 k% 


3 
2 


3% 
2% 


Loss of roots 


6' 




11 23% * 


3 


3% 


Spl i 1 1 i ng quadra t i c 

not equal to zero 
Square root 


1 


0% 


2 h% 


3 


3% 


Ar 1 t hmet i c 




■ 




2 


2% 


TOTAL OPERATOR ERRORS 


7 




21 k5% 


62 


70% 


ArPLfCABILITT ERRORS 






— ^ ■■ . . 






Appl icabi ! i ty 


1 


8% 


8 ]7% 


12 


13^ 


Group i ng 






\ 


1 


]% ' 


TOTAL APPLICABILITY ERRORS 


r 


B% 


8 m \ 


13 




EXECUTION ERRORS 












Partial execution 


1 


B% 


^"Tx 26^ 


9 


10% 


Faclor i ng 






1 






Replacement 












Fai 1 ures 9f control 


3 


2S% 




5 




TOTAL EXECUTION ERRORS 






18 38^ 




t 


GRAND TOTALS 


12 




^7 


89 





frequent. This is loosel y cons I stent with the finding of Davis and 
Cooncy (1977) that more, accurate solvers made relatively irore errors 
they called ^'computat lonaP', They intended by ''computat ?ona) errors 
of arithmetic, and as it can be seen, arithmetic errors are very rare 
amon^ the subjects, if sign errors are otherwise classified. Most of 
their "computer" errors woul.d fall in a "execution" category. It is 
important to note that tHIs observation may be due In part to artifact, 
however* since any subject who was prone to an error that would be 
repeatedly elicited on these pa^t i cu 1 a r. probl ems would automatically 
fall among the poor solvers. 

Pi scuss ion We have seen that a large number of errors can be roughly 
located in^_the framework of the Bundy model. In attempting to account 
for errors the framework of the Bundy model, or any other, one Is 
' challenging a common intuition that errors are the result of pertur- 
bations of correct performance due to inattention, random forgetting, 
or other unsystematic cause. There ire reasons to persevere in ana- 
lysing errors . 

First, so*ne errors tend to occu^r'^consi stent ly for given students: 
a student who makes one error of a given type is likely to make another 
Three of the errors were made five or more times by the same subject. 
Of deletion errors, SI had 5, S5 It), SI6 7, S20 16 and S22 10. S16 
made 6 recombination errors. S5 made 7 applicability errors and S5 5. 
Figure 5 JO conpares the obtained distribution of deletion orrors in 
session 1 only, where all solvers saw th* same problems, wltfi :he 
Polsson distribution. As can be seen, the errors are clumped together. 
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This suggests that a student has not an unsystematic tendency to make 
errors, but a tendency to make errors of a particular type. 

I F I gure 5 . 10 

Poi sson fit to deletion error frequencies 
for session 1 



Errors 


No of 
Solvers 




Po f sson 
Prohab i 1 i ty 


Expecjted No. 

of 1 u** r ^ 


0 • 


23 




.33 


( 11,22 


I 


6 




.36 


12.24 


2 


1 




20 




3 ' 


0 




.07^ 


2.52 


k 


0 ■ 

> 




.02 


.68 


5 


1 




.00^ 


.U 


6 


0 




.0008 


.03 


.7 


1 




.0001 


.00 


8 


2 




A .0000 

/ 
{ 


.00 


mean errors pt.r solver: 1 


.06 ^ 




Second , 


some errors seem 


to be 


consistent with the 


solver's state 



ments of what should be done, Indicating that it is not just the solver's 
execution biJt also his knowledge that Is faulty. While such cases 
suggest that errors can originate fronv faulty knowledge, two cautions 
are called for In Interpreting them, First, they do not help to estab- 
lish the proportion of errors Lhat ha)e such a systematic origin, above 
a minimum. Second, It Is possible that some or even all of these state- 
ments are explanations cfter the fact of what was done, rather than true 



accounts of knowledge underlying the errors. (See Nisbett and Wilson, 
I977t for a discussion of this problem in interpreting; self-reports.) 
So this evidence is not by itself very strong. 

Third, as a perusual of the tables of errors presented above 
revealft* errors are quite systematic in form. Very few errors seem 
at all like random distortiotis of correct performance, f^or one thing, 
the same or very similar errors appear in the work of different sub- 
jects. For another, the errors tend to reflect features of actions , 
that would be appropriate In other situations. Even if errors do stem 
from unsystemattc perturbations, therefore, a study of them must reveal 
something about the system being perturbed. 

Although the Bundy model provides a rough classification of errors, 
it does not allow ut* to interpret the derailed structurfe of the errors 
in the way this last observation suggests we must. Accordingly, we 
tale up this analysis in a later section, along with a consideration 
of other aspects of behavior that call for modification and extension 
of the simple model. 

- ■ • I ' 

r 

j 

/ 

I 

i 

•i 
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* CHAPTER 6 

Features of Skilled Performance 

Within the Bundy framework there appear to be two ways in which 
performance could be Improved beyond the elimination of errors. First, 
skilled solvers may develop more powerful operators^ that can produce 
solutions in fewer steps. Second, the pattern-matching ability of 
skilled solvers may be better developed, so that the skilled solver Is 
able to see the usefulness of operators that would be passed over by a 
less skilled solver. We can examine these possibilities by comparing 
the solutions of more and less accurate solvers. 

If skilled soj^ers are usi,ng more powerful operators, their solu- 
tions 'should have fj^wer written steps. The number of written steps is 
also influenced bvjbther factors, such as the number of steps performed 
mentally, but jsuch action would also be expected to shorten the solu- 
tions of skilled solvers. 

Average length of solutions As seen in Table 6 J, fhere is a tendency 
for more accurate solvers to find shorter solutions, but this is not a 
large difference and it is not consistent across problems. Figures 6.1 
and 6-2 show the solutions found t^y students among the most and least 
accurate solvers for two problems. In figures 6.1 and 6.2, each phrase 
separated by conimas indicates a single written line. When more than onq 
operation was performed in the transition between lines, these are sep- 
arated by colons. "Isolate" is used to refer to a step that results In 
a single term containing the unknown occupying one side of the aquation 
by itself. If the t^rnThas a negative sign this is Indicated^ because 
It generally requires) an additional step to change the sign. "DIst" 
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' .Table 6.1 



Average Lengths of Solutions 

Top 10 Middle* U Bottom 10 
Equation . Solvers Solvers >^ Solvers 



^ 

1 A 

i A 


2.0 


0 L 
L . 




•1 ib' ■ 






3.0 




* 3-3 


3.0 




— r- — 


Z . / 


3 . 1 




* 

JA 


3 .U 


#- 

3 


3 'Z 


IB 


1 


^ 6 


^ 2 ' 




2.0 


J 

1.9 


2.0 


4B 


5.2 




4.5 . 


5A 


3.8 


3.9 


4.3 


5B 


5.2 




- 4.7 


6A, 


3.6 


3.0 


3.6 


6b 




5.0 


— ^r— 

4.3 


7A 


3.5 


3.4 


3.0 


7B 


3.8 


4.3 


4.3 
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Figure 6 . 1 



Solutions to Problem 2A 



1 1 
X* 7 



Top Ten Solvers 

E3 

£5 

E8 

E9 

£13 
EI6 

S17 
S19 

Bottom Ten Solvers 
S5 

S6 
SI3 

S15 



i so]^te>^ Invert 

I >olat^, multiply by x, divide by coeff of x 
muUiply by x, collect terms, divide by coeff of x 
multiply by 2<x^ clear fractions, combine terms, 
divide by coeff of x 
i sol ate , i nvert 

multiply by 21x, clear fractions, combine terms, 
divide by coeff of x 

r 

isolate: multiply by x, distribute: multiply by 21, 
clear fractions, collect terms, divide by coeff of x 
isolate, add fractions, invert j 



\ 

. ^ 

Isolate -1/x, form common denominators, ^dd, change 
sign, multiply by x, divide by coeff of x 
isolate -1/x, add, simplify, change sign, invert 

m 

multiply by 3, multiply by x, multiply by 7, collect 
terms, divide by coeff of x 

isolate, add, s impi f fy : mul t i ply by x, simplify, 
M !p1y by 21, divide by coeff of x 



IRJC: 



5{; 
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Figure 6 

4 

Solutions to Problem 7B • 
6(x-2) -3('*"2x) * x-12 

dist 6: dist 3, dist - , simplify, tran^po^e:" 

combine terms ^ divide by 11 

dist 6: dist -3, set equal to zero: conbine 

terms^ transpose 12, divide by \] 

dist 6: dist -3, combine terms: transpose: 

transpose: combine terms , d i vi de by 1 1 

ident icaT to E8 • ' 

dist S\ dist 3^ transpose; transpose: transpose, 
combine terms: combine terms, divide by 11 
dist 6: dist -3, transpose, combine terms, divide 
by n 

dist 6: dist -3? s?mpl i fy, transpose: combine 
terms / d I vi de by 1 1 

dist 6; dist -3 > simplify, transpose: combine terms, 
divide by 11 • ' 

dist 6: dist -'3> simplify, transpose; combine terms: 
multiply by 1/11, sfmplify 

dist 6: <list -3f simplify: transpose. 2^, transpose; 
combine tern^, divide by -I 
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^ Figure 6^,2 continued 

Solutions to Problem 7B 

Bottom Ten Solvers 

SI ' i^i^t 6: dist --Sf simplify, transpose; combine 

[ ^ terms: di vide by 11 , s irnpl I fy 

S3 dist 6: dist -3, simplj fy , -tf'^n^ipose: combine 

terms, divide by 1 1 ^ , 

S5 d i St 6 : d i St -3 > simplify, transpose, combine 

terms , d i v i de by 1 1 
'S6 i dent i ca 1 to S3- . ' ' , - 

S13 set equal to zero, dist 6: dist -3, simplify, * 

transpose, divide by 11 
S15 Identical to S3 

S21 dist 6: dist -3T^ ^ i nipl I fy ; transpose 2^, trans- 

pose x: combine terms, divide by 11 

abbreviates ''distribute*'. Figure S.) shows equation 2A^ the only one 
for which the difference In length of solution was significant. As can 
be seen, the difference in length seems to be due in part to pcK^ 

choice of Initial step by some of the poor solyers / part ly to more fre- 

... V ■ 

quent use of ^he efficient inversion operation by the better solvers,, 
and partly to some combining of steps by the better solvers^ that were 
written^out by poorer solvers- The solution of SI3 Is a clear example 
of the expansion of a single operation^ clearing fractions^ Into three-' 
separate multiplications. So there Is some Indication of the expected 
differences between better and poorer solver. here. 



9S 



On. the other hand, Inspi^ction of the solutions to equation 7B'in 
Figure 6.2 shows that the d i f f^rerrce is not dramatic* This problem 
requires a number of steps, offering scope for combining of operations, 
but as can be seen the solutions .of the better solvers are for., the » 
iTOst part very similar to those for the poorer solvers. Subject E8, 
E9 and EI3 do show more combining of operations thao the others^ but 
it is clear that this is not typical, for the group of- better solvers, 
tt may be that these three subjects give some indjcation of wh^t solving 
is like for solvers who are more proficient than those who participated 
i n ^he study . . ' ' 

Use of subexpressions In many operator applications the pattern- 
matcher only need^ to handle simple terms: the unknown, constants, or 
products. of the unknown and constants, -Occasionally it is useful to* 
deal with larger subexpressions as units, and it seenis possible that 
more skilled solvers might be better able to do this, rat;her than break- 
ing down the problem into si.ialler units. 

Three problems in the inHJial set were designed to permit the 

r 

solver to exploit the presence of repeated subexpressions and treat 
them as units, as shown In Figure 6*3. In equation 7B the repeated 
expression is not apparent in the surface form of the problem, and 
identifying it requires sophf^t i cated matching. As shown in Table 6.2, 

n 

there is a tendenty for the more accurate solvers to use the subexpres^ 
sion^ more often. The table Includes all cases In which the subexpres- 
,sion was used, correctly or not. The co<nmdnest use in equation 3A# 
9(x^^0) • 5 (x+^O) was to cancel x ^kO from both sides, which is-in- 
correct. The hidden feature of equatl^^7B was used by only one sub- 
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ject, E12. As with the solution lengths, we can specu1a|)^^ that there 
may be more proficient solvers than our top ten group that would use 
such features, but it Is also possible that in working with simple 
equations such as these the extra analysis is just not worthwhile. 

These two areas of Investigation, solution length and use vOf 
repeated subexpressions, have not turned up dramalEic differences 
between the most and least accurate solvers in the study* It s^ems ^ 
fair to say that within this group of solvers the more accurate solvers 
differ mainly In possessing correct operrftors^ rather^than in having 
more powerful ones or applying them more effectively. 



... ^ 



\ - ' ■ ' S 



'.' \ Figure €.3 

^•N 

> 

Problems with repeated subexpressions, with scS^utiohs 



E7 3A 



9'(x+if0)-5(x+'+0) 
(9-5)(x+40)-0 

• ' ■\ 
, 7(^x-U-3(^x-l)+i4 

■ 7(^x-l)-3{ifx-0-A / 

(^x-l)(7-3)-^ 

(i4x-l) X- X ' 

4x« 2 

X V 



E12 7B 



6('x-'2)-3(^-2x) -,x~l2 
6(x-2)+6{-2+x)-x-12 
12(x-2) -x-12 
12X-2W-12 
1 IX-2VI2-I2' 
' .X - 12 

TT 



Table "6.2 

Use of repeated subexpressions in equation 3A and 3B 



\ 



number of students 
us i ng feature .dil 
either equatlt^n 

number not ,us i f)g 
featur^ ' 



Top Ten 


Middle 


Bot com 


solvers 


1^ solvers 


ten splvers 




6 


2 


6 


« 

8 


8 ^ 









^■2 



• 7 
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CHAPTER 7 ■ * • 

Modfff'.-DKcrepant Solvinq Behavior y 

in this Section we consider some aspects of subjects^ perfor- 
mance that do not fit well into the framework of the Bundy model. 
Part of the evidence to be discussed is drawn from the structure 
of the errors, presentifcil earlier: these suggest something about the 
organization of the knowledge subjects are using. Additional 
evidence 9omes from^he comments and activities that surround solv-, 
Ing itself; subjects do not simpl^solve, they also explore, e^val- 

uate and xheftk . ' ^ ' . 

\ 

Evi4ence of hierarchic! organization In the Bundy scheme there js 



a single pool of opet*ators, no operator being part of another. Stu- 
dents' remarks seem to indicate that their operators are Hierarchi-- 
cally organized, so that some operators must be expanded into a se- 
quence of other operations when executed. For ejKampfe, the joperat i on 
''factor^' must be expanded into a compl fcated< and unstandard ized se*-^ 
quence of t r i al -and-error attempts. The operator ^'multiply out*', as 

' ' ' 

applied to binomials, expands Into a series of four simple multipli- 
cation operations, which may be wri tten separately and npv be carried 
out in a standard order. Table 7-1 collects examples of operators 
appearing In subjects* comments ihat seem to have expansions. 

The expans Ions ,of operators Into parts seems Indicated dri>o by ^ 

' ' ' 

some of the errors discussed above.. In combining fractions, for example 

it appears that erroneous operators arise from the combination of pieces 

of correct operations. Th» assimilation of addition and multiplication 

I. • 

to a generic combination schenne, and of dlyision and subtraction to a 



deletion scheme^ also i nd I cate, that these operat ions are not unanaN 
yzed In the system'. However, the analysis suggested by this evidence 
is not an expansion into other operations, but a more general decom- 
position of the knowledge of the operators * 'separable parts, so that 
the basic co<Tibi nat Ion aspect of addl^'on may be retained while irore 
specific knowledge about its action may be ^ost or not learned. 

Table 7-1 

Examples of complex operations mentioned In protocols 



1 



find tf)^ common denominator 
get the x's together 

out all the -variables on one side ^nd the 
^ numbers on another 

cross mul t Ipl y ' ^ 

multiply both sides by 



subtract frou both sides 

multiply two binomials 

multiply whatS Inside the parenthesis 

multiply everything out 

di stribute . 

factor 

invert everything 



Matz (1979b) and Brown (li?79) have discussed the way in which 
partial Information about operations, embodied as ''critics^% might be 
used by students attempting to learn or recall' a given operation. The 



'^critics'' might block an attempted add 1 1 ion operat i on it lacked 
some kay feature associated with addition. Robert Neches (personal 
communication) has suggesfe^^hat the use of partial information 
to constrain an operation might be a basic part of the memory retrie- 
val process, in wh!ch the remembered pr^£:edure is built by the memory 
system, to embody as many remembered features as possi^ble. Whatever 
mechanism is responsible for the effect^ It does seei^lear that both 
abstract features of an operation (deletion for subtraction or divi*- 
sion) and pieces of related procedures {combination of fractions) can 
influence the procedures students use. ^ 

It would be interesting to know whether erroneous "operators are 

« 

built up at the time they are used, or during a learn'ing process that 
might precede their application. Only a few passages In the protocols 
suggest strongly an operation being devised on the spot. These are 
shewn in Table 7»2. Internal evidence from the Erroneous operators 
suggests, in some other cases, that the operator was created just^^^ 
fore application, TheserarV^ca^es In which the operator seems to have 
been shaped by the particular goal being sought at the moment of appli- 
cation,^ Table 7-3 shows examples. 

In the first ^wo cases in the table^ operators are devised that 
have the desirable property of moving x from the denominator, where it 
Is hard to deal with, to the numerator* Having , made the move shown here, 
S5 went on to use variants of it on three subsequent problems* The 
third case,S5 5A, shows, adjustment of the cancellation operator to 
avoid the problem of the vanishing unknown. The last two examples, in- 
volving recombination, may not reflect construction or adjustment of 
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Table 1.1 
Constructing Operations 



S) ID 



S5 20 



1 

2 



•x^ -X 



(x-x) 



:'*Pm not sure about that one,. 
Plus the properties are very 
confusing^ So if Vou do x-x 
thats- obviously zero. Oh wait' 
a mi nute* , ^ 



frhat'-s X times x minus x so if x nrinus x is zero it*d be 
X times zero, It'd be three halves equals zero. Can't 
do that, (pause) Well, i f thi s won * t work right here 
then I'm trying to figure out some alternative way o% 
doing it.'' 

E:.''What would the rule be - suppose you could do what you 
just ^id, you know, putting the parentheses in like that. 
Is there a general rule that you're using there. that would 
allow you to do that?** " . ^ ^ 

S: ^*Um, I believe it's the associative. Mm nol real 
positive but I think it j 



£: ''Could you 
th i s one that 



give like another example of it besides 
might indicate what the rul^ would be like?*' 



3 -kl^h) 
3^(3-2) 



18' ' S:.*M^ would be like ah cmi, three 

10 ' times two. I 'm just trying to 

figure out if this one will !: 
work. Three times two plus 
4 four thatid be three times 
six that eqcidls eighteen. Three times two plus four no 
that doesn't work. Ok, the property i *m trying to tihilyk of 
I guess it just does for, Tf the mode of, whatever, if it's 
addition or whatever is the 
minus two, that would work 



rocal 
qy { te 

\_ ^ 

3 



of a 
sure 

k 
1 



numb^^r you have 
about that.'* 



same, like three plus three 
! think when you take the recip- 
to change the signs but Mm not 



1 1 



was trying* t)o give numerical values 
to the variables but I didn't tiiink about 
the equal sign when t made 6/3^equdl to 



-3 



-2 



4/2 but 2 Is equal to 
exactly what I want . 



2. ^But that's not 



\ 



x" 



■5/ 



' ( was trying to see if takir If taking 
the reciprocal meant that I had; to change 
the sign to the opposite. What Mm 
thinking of Is when ypu have an cxf>onent 
on the bottom that's negative, when you 
take the reciprocal it becomes positive « 
But, I really am not thinkin too much* 



Table 7.2 continued . 

SI 5A lilt 

J - ^ + y — ^ J - 7+x S: *^This one i can ,do. Cross 



/ 



X 



mult^ply'^ |t,doesn*t seem ' 
to me ^1 ike that'd be right. 
J Ok all right, it*snot right"' 

changes to ^ 

3^^ 7 . 



lO " x+S ^O-x-^S 



> 15-x ^ S: **You get equals x. But x ' 

5»x * . %hould be t?:c same, HaHa^*. 

■ ' **So I *m thlnkl.ng It's messed up, 

Maybe you could f.et the 2 
equations^ but they're not 
equal to each 'other. Reduce 
% 5/JO to one half and set x 

> minus *10 equal to one and x 

'plus five equal to five*' (gets 
V x-11, x—3) "You could solve' 

it as a system and s-y a minus 
10 equals 5, x plus 5 equals 
10, and then subtract this 
whple equation frcw this orle. 
Maybe we shou-ld add the two 
equations/' (gets 2x-5-15, 
x-IO, checks) "So that would- 
n't work either. I don U know, 
I don't understand why it does 
\ not work out ." 



thp recombination operator, but may simply i 1 1 ust rate I ts flexibility. 
All three errors in the two exanples seem to bt well calculated to ^ 
attain a useful end. \ The first error separates x^ This is however ^ 
next undone to permit cancellation of the 2y term, |n the last ek- 
ample the recombination chosen allows x to tj£ easily Isolated. 



Table 7.3.' 



Goal directea errors 



— + — 4- tftrst, then 

X 7 ' X d . 



changed to 



1 7 



S5 2A k _ 2] 



21 21 X '21 1 

• - -2, then later 



S5 5A \_ , x'lQ I 

1 0 ■ ;<+5 ^ 2 



x+5 2 ^. - 2 




S22 4A xy»-yz«2y. 

X'»-2yz-2y- 
x2+2y»2y- 

X2-0 



S22 bcx + acx -rabx + abc 

3abc + 3x - 0 > 

, 3x--3abc > 

x"-abc 



Some cf^aracter i St res of Erconeous Operators As just .discussed, 
erroneous operators might be put together using existing knowledge, ' ' 
and then applied. Another way some erroneous operations could "arise 
is by switching between correct operations in mld-exccution» Thus the 
student (night not possess the incorrect operator as a stable entity. 
If ccHTiplex; operat ions wcrr Implemented by sets of product fonsMn a pfo- 
duct Ion system one could readily see howjnvalfd hybrid "cperat fons might 
be carried out by the system in the <^ent of loss of control Information 



from memory. A stack diccipUne, in which a stack is used to bold 
pending parts of expanded operators, could also-fail In such a way as to 

« 

produce mixing. Sdxne ,of the errors in combining fractions' in Table J.k 

\ ' ■ ' /■■/ 

might lend ' themse ! ves to this kind of a9COunt (Richird >^ung, personal 

ccHiynun i cat ion) . Such mixing of operation, if It /occurs, would necessi- 
tate an analysis of operations into parts,- ' 



SI 6C 

515 50 

5 

516 7E 
S16 5D 
S22 2D 
S22 2C 

Sl6 .2B 
S22 2B 



S20-2A 
S21 

S22 2E 



^ x+1 



Table 7.^ 

Errors in combining fractions 
V x+x+1 



\ 



.1 2 ^2 

^ ^T?CT 



(M/x) ^ 



x+3 



7-X+3 



-X 



_ + _ 
r c 



1.+ 

7 3-x 



8 

X 

b 



3^ 



1% 1 



X y z xyz 



i y 

l/x+l 



3-0. 



Comment: "multiply that 
■ maybe (points to 2) " 
times that , (points ^ 
to 3) and- add that 
(points to numerator) 
to 1 1" . Maybe based 

a a 



on J_ ^ 



One ca/e-.of mlxingyof operations in correct performance f§ shown 

I 

/ 

in Figure 7.1. This large -^tep may arise as a combinat/on of n c^is,- 
tributions, n transpositions, and n combi nat Ipiis of terms. T^e result""' 
was written strictly left-to-right. Although the operation accanpl^ shes 
all the effects of the mentioned operatjon^s, It may or may not be a 
mixture of them in the sense discussed above. As pointed pat^y Robert 
Davis, personal communication, it is p.ossible to define ^single pfo- 
cedure which gives the desired effect, and 'the student might, simply be 
using such a procedure- wl thout reference to the srfialler operations. So\ 
thiii example, like the cases of combination of fraction^, does not \ 
establish that pieces of operations may be mixed during execution.. 

Figure 7.1 . 

A complex opier^tlon 
.£'3 7B .6(x-12)-3(^-2x) « x-12 



6x+6x-x " 12-^12-12 

1 Ix » 12 

X - II 
11 



The kinds of control mechanisms that might [produce mixing of oper- 
ations might account for other kinds of errors. The Idea of partial 
execution presupposes a control system (n which it can happen that only 
part c' an operation is carried out. Both the production system and' 
stack discipline have this as a natural mode of failure. In a {pro- 
duction system, if not all the tests that make up a condition were 
accurately checked, a production that should Kave awaited the completion 
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of. an operation being carried but by a, set of other prodictions might 



apply prematurely. It is not necessary to assume that "^he act ion of 

\i any'^ingle production could be only partly performed, 

, ■ * . , ' 

If a stack discipline were used, it would be necessary to 'assume 

that I terns are sometimes simply lost from the'^stack. The prevalence 

pf sign errors might suggest that some pieces^ df o^ra^ohSp such as 

sign setting, are more lik^y to be. lost than others. However, only 

some losses wijl show up as partial executions, since loss of Veal ly,. 

> vita! early parts an'operation would result in inability to perform 

the later parts at al^ and perhaps lead to reloading of the stack. 

for huii>an solvers Operators are apparently not units of knowledge 



that either are known or unknown, as they are in the Bun^ model. 
Students fr.equen 1 1 y, expressed doubt about the correctness of operators 
they used. These doubts seem to lead-to behaviors that would be un*- 
necessary in a solving system that had only definite and certain know- 
ledge of its operators. First, students monitor the progress of their 
solutijpn, making evaluations of the states J^hey reach. They may back- 
track if it appears that what they have done was not leading jn the" 
% • 

r ! ght d i rect Ion . - \' 

Table 7*5 collects examples showing evaluation of the situations 
reached in the solution process, grouped according to the aspect of the 
situation that is attended to. During the ?:ours7 of solution, the com- 
plexity of the equations formed is^ noted ^ though it 1$ unclear what deter- 
' • mfnes the judged complexity. Also, the legality of moves is ^ssessied:^ 
solvers may plan or even. scarry out moves which are then retracted be- 
cause they are judged not valid. Solvers iilso try tp avoid returning 

m 

to* earlier states. Group 3 of the table shows examples. When the solution 
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process Is complete, the solution or solutions obtained are evaluated. 
K may be that the conclusion Is that there Is no solution; s.Ince this ^ 
Is rare, solvers may use an alternate method to be safe. If a solution 
is obtained It may be checked*, as discussed below^ and If It Is found 
wanting, a new method may be used. Soiyie solvers seem to be aware that 
a quadratic equation has two roots, though they may not be distinct. 

Q ■ ■ 

The Table shows two cases In which failure to obtain two distinct root^ 
may have led^to new attempts. 

Not all backtracking is controlled by this sort of evaluation, of 
course Sol vers may reach a dead end, a state to which nonappropriate 
operation can be applied. This forces backtracking. The fin'^1 group In 
tKfe Table shows a few examples. 

A second behavior made necessary by imperfect knowledge is checking. 

7. ■ ( ' 

/''Students may check their answers or the solution proQi^s^^, and may check 

ttie process as a whole or in part, by a variety of methods. 

i' 

Methods of checking may be divided into 1 ocal and global meth^s. 
Local methods indicate whether some particular step In 'the solution 
process is correct or not. Global methods indicate whether the solution 
proce^as'a whole is correct. Within these categories, different methods 
with different character Is't i cs exist. Table 7^6 lists the methods used 
by students on the fourteen first-session problems/ 

Considering first the local methods, by far the most common Is re* 
tracing thersolution process. In this method, the solver examines each 
step of the solution to see whether the intended operation was accurateTy 
ciarried out- The problem is not solved again, because the checking is 
done by referring to the written trace of the solution. This means that 



Table 7-5 
Evaluations 




Group 1 C'dmplexity 



ElO 3B 



S5 2A 



S12 2B 



S15 2B 



7(4x-l)-3(Ax-l)+A 



3 X 7 ^ 21 



1- 1 = ^ 

8 y z^"^ 



x^' x^ 



1 1 11 

— - — « — 4- 
R X y z 



,^zx - yzR « Rxz + Rxy 

— > 



y 



1 1 
— • — 

Z X 



i£ - ii - Ix 
p y ^ 

xyz~x7p-xyp 
pyz 



S:"Well actually I don't be- 
lieve that's going to -hetp - 
me any. It'd complicate, 
things more in the long runV 

S: "That's not, that do5^' t 
look ok.' I 'm 'going to do 
it anpther way." 

S:' l'm try4ng to see If I can 
t^ke X' squared and multiply 
this (points to 1/x) by x 
squared and get x" dqgps so 
"! 'm not approaching it. 
I'm not even coming to it."- 

"I'm going to try a differ- 
<2.ent way. I don't like that. 
It's too complicated.'' 



SV It. just doesn't seem like 
' It simpli.fles anything." 

S:''l t^nk I made it more cooi- ' 
pi i cated .". - 



Group 2 Legal ity^ 

Eh 2A 7- ^ 3— > x-2 (incomplete) 



SI 2A 



3 X 7^3 ^ 



S:"Take the x over to this 
side and bring this seven 
thfougt^^Can't do that." 

SV'lt doesn't%e«Ti to me like 
.that;d be right. Ok all 
right. It's not rtght" 
changes to J_ . 

3 7"^ 
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Table 7 .5 'cont inued 



I 



Grcup 3 - Return to earlier state 
S5 6A' x+2(x+1)^4 — >r • ■ ) 



:"i can't go back because 
I cQm# up with th I s ^ 
(po?nts to original left 
hand s ide) I f I try to 
factor down so^M just ^ 
going to leave it like 
that/* 



|13 



2B 



yz (x-R)»Rx(z+y^ ^ 

yzx-yzR' » Rx2+Rxy 



S20 6B. x+2(x^2(x+2))«x^2': ^ 

Group k ' No solution 

E3 3A 3(xflrt)) » 5(x+i40) 

Similar:' 

E6,E9,S11 

SIOJA 



S:We*re going to factor out, 
naw, that will gfve me 
the tijb'^g I started witf\/* 



S;^M can factor this back 
down but that won * t do 
me much good/' 



cancel s ^;^t hen remarks 
»'9«5 doesn't exists so 
1 goi ng to work out 
the problem to see what 
1 real ly got /' 



E9 58 



l-x2 



: solves using quadratic 

formula, gets x«] . 

Checks, 
"And the first thing you 
notice is that when you 
plug in one for x up here 
you*re dividing by zero. 
So there is no solution/* 

Then solves by cancel ling - 
"Ybu notice that there's 
again no solution; All 
rlght/V 



Table 7-5 contiruied 



Group 5 
£li* 5B .. 



Number of roots 



1-x 



] -X «• 0 

or 
l+>; « 2 



V 1 



SI 1 IB 



2x"x' 



2-x 



S: "Cancel these 1 --x by 1-x 
if 1-x is equal to zero * 
and X equal to one. And 
the other answer would be 
i+x l§^*fequal to 2. X equal 
to 2 minus one would be 
also, one. Therefore no we 
can't say that that's equal 
to zero because that's 
(points to 2 on right hand 
side of equation with can- 

, celJatlon) not zero,' Ok, 
that's a "good question." 

Solves by multiplying by 
l-x, obtaining (x-1)2"0.^ 
"Ok that's the reason w*? 
got 2 answers x-1 up ^jiepe 
because we ha<'e x-l. have 
&s an. answer for both of 
them. 

S:"l believe I 'can divide by 
X. Let's try that" checks 
both negative ^nd posltiye 
2 as solution. "So it's 
positive 2 only I guess. 
Another way, can I solve 
this another way?" .forms 
x2 -x-0, solves, ffnds ' * 
both rooti. "That's cor- 
' rect." Crosses out 2-x. 



Group 6- Dead ends 
E7 x2-2x-^3-0 



S6 6A x^+3x-2-0 



S:Equ£rion obtained by an 
error, "This one. doesn't 
scam to factor very well. 
That's why, I made a mis- 
take." corrects 

similar , . 
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Table 7.5 contir:ued 



SI 5A I ^ ^ x-10 . S:"l know what I can do I 

•2 x+5 ^ 2(x-)0) ^ ' think. Multiply, cross 



multiply.'* 



SI 5B 1-x^ ^ 2 V 1-x? 

• T — ^ mr 



S20 x^'±>i * 1 V 1+3 « 1 S:*'Broke down the equation 



but ah its not going to ' 
equal. I^think I *m going 
to have to skip that one/' 



S20 lA A-p^prt > >-l«rt ^ * , S: Solve for p 

'*That*s about as far as 
$ . ' . it goes." 



there is dang'ejr that an error made in the solution may be repeated 
during checking^ eifner because of a stable conceptual error or beci'ause 
,of sofiie temporary lapse. Excerpt E8 1A in Table 7-7 shows one student's 
handling of this second difficulty- . ' ^ 

There are a f^ew cases, collected in the next category in Table 7.6^ 
In which only a single step of the solution process M checked by re- 

4 

tracing. This was done three times to check the product of binomials, 
once to check clearing of denominator, and once to check conversion of 
a fraction to a new denominator. 

A local method which has the advantage that It could detect even 
stable conceptual errors is checking a step by carry?ng out the irtverse 
operation of the step. This was seen seven times, each time to check 
factorization by mu^ltlplying the factors. The m«thQd could>e, applied 
to other operations, such as simplification of quotients by caincelUng, 
using multiplication of numerator and denominator by h\c same quantity 



1!6 



Local Methods 



Retrgce solution 



Retrace single 
step . 



Table 7.6 



Method Checking 



Cases 



Number 
of cases 



E8 


1A 


E9 


7B 


E9 6B 


23 


E8. 


7A 


E9 


1A . 


E]k 2B 




e8 


*6B 


E9' 


kB 


-E16 7B 




E8 


2A 


E9 


5A 


S3 6A 




E8 


5A 


E9 


k^ 


S3 3B 




E8 


3A 


E9 


7A 


S5 '7B 




E8 


h^ 


E9 


2B 


S17 7B 




E9 


6A 




3B 


f 




&16 


2A 


S3 


7A 


S5 6b 


. 5 


S3 


2A 


S3 


7B 







Perform inverse 
operation 



E5 5B 
E16 5B 
SI 1A 



Sll 5B 
sn 4B 
S13 6B 



S13 2B 



Humeri cal 
Substi tut ion 



,S5 5A 



Inval id Variant 



S5 68 



Analogous Pfeblem 



S5 6B 



Global methods 



Substitute Answer 



Consistency 



E3 


5B 


E16 AB 


S17 6A 


E3 


3A 


E16 2A 


S17 5A 


E3 


3B 


|16 IB 


Sl8 5A 


E3 


6B 


S3 IB 


S23 IB 


E3 


48 


S5 7A 


S23 7B 


E3 


5A 


S8 7A , 


323 5B 


E5 


4S 


^ S10 5A 


S23 3B 


E8 




Sll IB 


S23 2A 


E8 




S17.5B 


S23 7A 


Elt 


5B 


S17 


S23 6A 


E12 


5A 


S17 2A 


S23 5A 


E16 


58 






S5 


2A 


^ S12 lA 


S13 2B 


S10 5A 







\ 
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Table 7-7 



Protocol excerpts on checking 



E8 1A 



Student checks at. end of series of problems. 
E: "Do you hav^ a particular reason for 
checking at ttie end of the whole series 
rather than checking each one as you go along?" 
S: "Yes, I'm not as 'likely to make the exact 
same mistake twice: After you've done some- 
thing one time it -tends ,to fix in my mind and 



if I try to check it immediately 
to just do it over.-again." 



I 'm liable 



S5 7A 



16-0- 



-*x- 



16-0 
- 16 



"I don't know whe ther 1 
should do this, ^^ct'^e 
try this." subsTTttrtes 
16 in original eqxjation, 
"Definitely not." 



S23 2A 



1.1.1 

3 X. 7 



i_.l } 
21 x 



;"l 'm trying to think i f 1 
can cross multiply to find 
the answer or invert the 
fraction. See If that 
would be the answer. I 
don't remejTiber if that 
works or not . It' 
a long time since 
algebra, so God, I 
know what to do . 
cross multiply I 



s been 
I 've had 
don ' t 
Urn, if 
'd have, 



21/4 for X and that let's 
see, k 21st and 3 7 21sts 
and that's the answer so 
that 's what I 'd do." 



S5 2A 



1 

— + 



X * 21 




IT" TIT 



"Four 21 is equal to x. 
That's not, that doesn't 
look, Ok I 'migoing to do 
it another way" does so 



er|c- 



no 







Tabl ft 7 . 7 cont inued 



1 1 1 1 1 1 
3 " X ^ 7 " X " 7 " 3 



cross mul tipl ies 



^ ^ k S:''But' It's exactly thej' 

opposite of what I did 
) over here. I must have 

done something goofy/' 

rechecks cross multiplication 

'This IS strange. If I 
worked it two ways I should 
cofT^ out with ttre^ same ans- 
wer considering afS Udid 
. was switch to the other 

* side of the equal sign. I 

must have made. Oh I see 
what I did/ (Points to 

1 

I made it x over one. No» 
that is correct.'' 

S13 2B S: 'M ^m trying to get the same thing up there 

to see if I did It right or not/* 
gets agreement 

"Ok, I suppose that could be the answer. 
. There's too many variables. You can't 

work i t out." . 

St 3A Checks answer by substitution, get 0 « 0. } 

S: "Uri that still looks a little awkward. Normally 
you don't come out with zero is equal to zero. 
So I'm going to select a number, lct*$ say 20, 
and put it in and see If any other number will 
come 6ut other than -kO.'* substitutes "And I 
have 60 times 9 is 5^0 and this is 60 times 5 
is 300 which Is not the same, so ah basically 
looking at it I would say that -^0 is the ©ne 
and only solution*" ^ 

» 

S17 7B S: "Let's sfie I'm just checking over this. It doesn't 

i *m looking for a quick solution like couHd I . 
divide 12 straight through. Well I couldn't 
because there Is an x there. And what I'm looking 
for is sometimes these problems are made where 
you're looking for a simple way to get some 
•factor out so I'm just seejng 1 fx maybe I madc,- 
a mistake. That's 'a quick way for me to catcti 
" • an error^." ! 
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S17 6B 

SI 7 

S23 7B 



Table 7.7 ccnttnued 
• / 

"There's no fraction so I don't^see why to 
check it, and I'm beginning to feeKa little 
bit more confident ." 

* * • ■ • 

^'No we^^nead to go back and check qd cause we 
haye a fraction here.*'' * * ^ 

"And I probably wouldn^t even go back and put 
It in because it came out ev ;n and lt*s too 
much trouble with all those numbers,** 



as the Inverse. The requirements are that an inverse exist, that 
It be known by the student to be the inverse, and that Ihe student 
be able to perform tlie Inverse operation accurately. 

A more generally useful method, that could be used to check all 
steps that replace an expression by an equivalent expression, is trial 
evaluation*. If expr is to be replaced by ^ixprS then all unknowns 
and literal constiJits in expr and expr* are assigned numerical values. 
The expressions are^then eva 1 uated , and if expr and expr* are equiva- 
lent the^ values obtained must be the same., The method is only of 
heuristic value, since it may happen that the values obtained are the 
same-even when expr and expr' are not equivalent. One student verified 
that x/x could be simplified to x by^ finding that 1/1 is 1. But prudent 
<;hoice of numerical values, and the use of more than one assignmcn.t In 
especially doubtful cases, can make the method quite reliable. As 
shown *n the table, this method was used only once in session 1. 

The same solver used an invalid variant of this method in one other 
case. To check whether a factor could be cancelled from the two sides " 
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of an. equation the student set up the "equation" 1- (1) (^), and then 
tancelled the Ps. Since the origirfal *;equation** Is.not^ valid it Is 
hard to see how the cancelltlon can be c^iecked. 

The same solver used one more local method to investigate the \ 
same cancellation operation. This time a simpler problem of the same 
form as the problem being attempted was created, and the doubtful st-ep 
attempted on that prot^iH': the original problem was x+2«x+2 {x^^4x+A) , 
the doubtful step being cancellation of x + 2, and , the analogous pro- 
blem was a « (a) (b+c+d) • in this case the analog was not a useful 
check foV two reasons: first, the student was no more confident of 
the correctness of tue step as applied to the simpler problem and 
second, the analogous problem Is' not really analogous, since it embodies 
a false i nterpretat i on x>f the grouping of terms In the original. 

Turf ng to global methods, the commonest met;hod of all is checking 
by subst .Ing the answer into the original equation and seeing whether 
it reduces to an identity. This and other global methods have the draw- 
back that they provide no information about what step in the solution pro-- 
cess is faulty, If the answer' does not satisfy the equa'ti,on- Commonly^ 
when substitution indicates the presence of an error, the student retraces 
the solution process hoping to spot a mistake. As noted above, retracing 
can fail because' of a stable e,rror^ so it may be necessary , to attempt an 
alternate sol ut ion method rather than patching up the original solution. 

\n two cases, S5 7A and S23- 2A, students ap^ar'ed to use substitution 
checking as a local ch^ck;' There was just one step they were doubtful of, 
which they checked by obtaining an answer and substituting. Excerpts from 
these protocols are Inclyded In Table 7.7. 

'The only other global method used Is cons Isteficy checking. Here the 
student compares the results of two different solution methods which should 
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agree.' The pr^Jtocol S5 2A, .excerpted T<4ble 7-7,' (Illustrates the diffi- 
oulty of using a global method to find an error, 'The student locates the 
incorrect step In one of two conf 1 i ct i ng solutions, but is confident 
it is. correct . , * - ' ^ 

' The other three cases of the use of this method also deserve Special 

) ■ , ; ■ . 

comment. In one,. SI 3 2B, the solver had started and eventually abandoned 
one line of work."* A second line was also'bogging down. Before 'abandoning 
the problem the student checked for errors in either Ijne by working from 
the end of- the .second line of work to obtai-n the equation reached at the 
end of * the first line. This protocol is Excerpted in Table 7.7. In SIO 5A 
the two alternate solution methods begin from the two equations obtained by 
eplUting an equatiob of the. form a/b « c/d into a=c and b-d. Having job- 
tainlng a solution to the numerator equation the'student solved the denom- ■ 
inator equation, aii'd, since the'solutiop was different, realized that an 
error had been made.' Tha.f the error arose in the splitting process was not 
realized. . In case S12 lA, discussed more fully bejow, tho student solved 
the equation, which contained literal constants, by solving an analogous 
equation with only numeric constants ' and then decomposing the numeric quan- 

\ 

t i ty .obta i ned as a solution into an expression in the original literal terms 
Rather than check this solution by substitution, which would have entailed^ 
the manipulation of literals that were avoided in the. sol ution, a check was 
attempted by repeating the solution process using a different assignment 
of numerical constants. Unfortunately; an error in the second solution led 
to rejecting of the answer obtained earlier, which was in fact correct. 

As mentioned above, meth6ds differ in the type of error they can 
detect. Since the type of error different solvers are likely to make 
differ, different methods will be appropriate for different solvers. 



specifically, one would expect better solvers to have le|s need to 

check for stable cbnceptupl errors, while this would be crucial for 

solvers with many conceptual confusions. Accordingly, a method like 

retracing would be more useful for good solver^^than for poor ones, 

though a method like substitution of answers which catches both " 

stable and unstable errors' would be'better for both groups. 

Table 7.8 shows the frequency of use of the various checking * 

> 

methods broken down according to the accuracy of .the solvers/ As 'can 
be seen, checking is much more common among better "sol vers , especially 
when number of cases of checking rather than number of students check- 
ing is considered, 

Table 7.8 



Checking and Accuracy 



Method 



Loca 1 



Top 10 • 
Sol vers 

cases solvers 



ret race 
retrace part 
i nverse 

trial Rvatuat i on 
i nva lid var i ant 
analog 
Global 

st/fest (tution 
consistency ' 



20 
I 

2 

0 
0 
0 

19 
0 



5 
1 

2 
0 
0 

0 

6 
0 



Middle 1^ 
. Solvers 

cases solvers 



0 
0 
2 
0 
0 
0 

^13 
2 



0 
0 

1 

0 

o 

0 

2 



Bottom 10 
Solvers 

cases solvers 



3 
k 
3 
1 
I 
1 



2 
2 
2 
1 
1 
I 



Anx 



1*2 



a/10 



17 , 7/\k 



17 



VlOo 



.. .. 

* 

An argument could be made that trial evaluation would be. the method 
of choice for poor s'olv^rs. Ltke substitution, it can detect stable 
coiiceptua] errors of the sort poor solvers confront, but unlike substi- 
tution it can be used to test a single suspect step and so avoids the 
problem of determining where in an entire solution things went wrong. 
As can be seen, this desirable method is virtually unused. 

The jnitiation of checking can apparently be 'control led in vari6us 
ways. Some students appear to check as a general policy, while others 
will check only wheg they have some reason to be doubtful about some 
step they have taken or some unexpected feature 'of the. answer. Scxne 
excerpts from protocols that bear on this question appear in Table 7-7. 
Case E3 3A shows a check within a check: checking by substitution doesn^t 
usually come out with 0^0, so the student considers the possiBllity 
that the equation might be satisfied by any value, which would render 
the check by substitution trivial. In case S17 7B the solver expected 
th^at the solution would Involve some trick and since none was found an 
error is suspected. The two cases S17 6B and S17 indicate that the 
soiver regards problems with fractions as especially needing checking. 
It Is not clear whether this is because of their difficulty or whether 
the specific problem of extraneous roots is behind this idea. This solver 
did detect an extraneous root^ and so was aware of the. problem. Finally, 
case S23 7B Indicates that checking will not always be done even when 
It might be desirable. 

Another difference one might expect to find between human solvers 
and the Bundy model arise5 from the fact that equations have no mean! ng 
for the model. The model incorporates no knowledge about algebra that 
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connects algebra to any other domain of knowledge. Greeno (1976) 
has argued'that such connections are an Ingredient of what we call 
understanding, and play a role in learning, recal 1 , and transfer . 

As shown in Figure 7.2, there .are two domains in which the equa- 
tions manipulated in algebra can be assigned meaning. Expressions 
and equations represent numbers, functions, and relationships among 
these. These ei^tities, in turn, are often used to represent physical 
quantities and /their relationships, or other relationships between 
quantities i r/ the world, such as the relationship between discounts and 
pr i ces . S Havl ng an Interpretation for the objects being manipulated can 
be useful In checking results obtained. , No physical or other practical 
interpretation was supplied in the present study, and there were no re- 
ferences by so]vers^to any interpretation of that kind. 

Figure 7.2 



Domains for i^nterpret I ng equations 



Symbo 1 I c doma I n 



equations , expr'esslons 



Mathematical - 
doma i n 



numbers, functions 
relationships among these 



The real world 



physical processes and other 
quant i tat t ve relat \ onsh jps 



The mathematical domain a|so provides potentially useful Inter- • 
pretatlons for equations and their parts. Expressions represent functions, 
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and equivalent expressions are just those that represent equivalenit 
functions (Note that ^'a-^b-a'' and *^b'^ represent equivalent functions In 
the sense needed here, but not. identical- functions, since the first 
function has an extra varjable.) Since equivalent functions have 'the 
same value for corresponding arguments, it Is possible to test the 
equivalence of expressions by evaluation! this is just the trial evalua- 
tion method described above, which was used, by one student. This check 
Is semantic In that ft Implicitly used the correspondence of expressions 
and functions- It Is questionable that there was any explicit knowledge 
of this semantic relation, however, since this student , t r I ed to use the 
method Inappropriately at least One other time, In a way that violated 
the necessary correspondence between expression and interpretation. 

There is not much indication, then, that meaning plays a large role 
In equation solving. That does not suggest that It could not do so, 
however. One might hope that the prevalence of ridiculously invalid 
operations could be reduced if students knew enough about the meaning 
of equations and expressions to assess the correctness of their actions. 
We return to this' point in the discussion. 

As a final point of departure from the Bundy mode] , we present 
some non-standard ways to solve equations. These serve as reminders 
that* people, unlike the Bundy modfel, are not specially adapted to alge- 
bra, so one can expect invented me*:hods to appear here as they, do else- 
^where in mathematics (see Resnick, 1979)- 

The ordinary way to solve an equation Is to transform It' Into an 
equivalent equatior\ or set of equations which Is In the form x * expr, 
with expr free of x. This Is the met^^od^sed by the Bundy system. Two 



other methods appeared in t^he study , hov^ver . These A^hods avoided 
transformfng the equation. 

One of these methods occurred only in the si ngle^ example shown 



in Figure 7.-3. The student had attempted to sol^^e the equations In 
the normal way by transforming it, but had trouble with the formal 
manipulations required^ So he transformed the problem to an analogous 
one'with numeric coefficients. This could be transformed .using arith- 
metic Instead'of some of the formal operations, and ^solved • Then the 
solution^ the original equation could be formed by tracing the solu^. 
tion of the ^numeric version. 



Figure 7. 3 . ^ . 

Solving a numerical' version of a'^j^blem 

S12 lA A - p prt restarting after 

abandoning l-A » -rt 

. A-'3 

r» 2 : • 

t= 3 / 

3-x+x(2)(5) 
3-x+lOx 

IIX • 
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The other methcwi vyas used more often, but Its use Is obvious^ only 
on problems for which It leads to errors, since on /many problems it. 
looks, like soljutlon by inspection. The method requires the assumption 
that a sblution of an equation will^ when substituted into the equa- 
t'lon, make the two sides of* the equation I ook the same.. Thus 2 is a 
solution of 2x » xT, because 2*2 looks the same as 2^2, Zero would^not 
be a solution, or" perhaps not as good a solution, because 2-0 and 0-0 
do not look the samQ. The method becomes distinctive when applied to'^ 
equations involving fractions. Ex^amples are shown in Table 7*9. As^ 
can be seen, the equation Is split into two equdLlons^ one c^f which 
will when solved make the numerators the same, and the other of which 
would make the denominator's the same. Unfortunately, it is not clear 
how users of the method deal wi th the^ usual situation In which^ these twa^ 
equations have different s'olutions. In one case, SIO^Bt It appears 
that it was assumed that e i ther equat Ion would yield a solution. In 
other cases the i nyest igati on of the two equations became cbnfused and 
/inconclusive, because of errors. 

r 

Table 7-9 

< 

Splitting equat ions wi th fractions 

S16 5A ■ 5 . k-10 . S-x-lO 

. To ' x-eS 10-x-f5 

5E ' ^ X 2x^^3-x 

3x+9 3 3x+^-3 

X . 

SIO 5A\ 5 _ x-10 V 5-x-lO' 



10 x+5 
j-xi • 2 ^ . 

y- • - y X 

1 ~X 1 



516 5B ; . 1-x^ _ 2 ^ 2 



CHAPTER 8 




Discussion 



We now return to the five general issues raised in the Intrc* 

ductlon, and consider what 1 i^ght has been shed on each by the re- 

i 

suits of the study. 

•» 

Errors and mechanisms We have argued that the errors we observe can 
be divided into three types: operator, applicability, and execution! 
The three types have d i fferent' preventive or reme4ia1 measures. 

Operator errors seem to reflect incorrect knowledge, or Incom- 
plete knowledge that is overextended onder the pressure of solving. 
The erroneous steps seem to be the distorted and fragmented, but seldom 
cornpletely^/unrecognlzable , images of correct operations. The task of 
preventing such errors seems to divide into three parts: making initial 
learning more successful, discouraging the later construction or re-- 
const ri|ct ion of incorrect jiperators , and correcting existing incorrect 
operators. We have little to suggest about this last part of the task, 
beyond remarking that the- kind of detailed diagnosis we hav^ atteiTipted 
may be essential in dealing with students' difficulties. This study 
included no intervention, and so we do not know what would have happened 
\i SI, who gave such an articulate account of the cancellation e/rors tn 
Figure 5^6, had been given at that moment an accurate analysis to con- 
sider. ^ 

The 5^ detailed analysis of^ ^srrors may be Import^t In ln^>rovIng 

Initial learning. With respect^to deletion and recombination errors In 

J* » 

particular it seems students are Inclined to take a rather generalized 
view of th*: operations" they are learning, and ^ith the nature of .the 




Jikely over generalization in mind it might be -possible to choose exam- 
pies In-'teaching that would bring out the. needed discriminations. 

A second attack on, the problem of initial learning H through meta- 
knowledge of right and wring, If the student can d i st ingui siT a correct 
operator from an incyrect one, then he or she can edit out the wrong 
guesses and generalizations that must inevi tably' f low from limited exam- 
ples and i 1 I -understood explanations. We will return to this in dis- 
cussing the kinds of knowledge students should have. 

In discouraging the construction or reconstruction of erroneo^JS, 
operations knov/ledge^of right and wrong is still clearly, important, 
since the problem of f i 1 ter ing correct operations from wrong guesses 
(Matz, 1979a) is fundamentally the same in et>nst ruct ion as it is in 
initial learning. There is a second attack on this problem, however, - 
that may be worth considering, .though it is disturbing: Perhaps students 
should be discouraged from trying to figure out algebraic operations 
they do not understand. ft may be that trying to stretch inadequate 
knowledge results ,in creating, patching up, and so preserving false 
notions; as well as preventing requests for help. Such an approach 
raises the problein of helping the student see the boundary of what it 
is sensible to try to'^work out and what it is not, but that problem is 
a real one and cannot just be Ignored- 

The bulk of applicabinty errors Involve mi shandl Ing of parentheses, 
with the" terms In an e;<presslon befng assigned a false grouping* These 
ehrors are quite cdmmqn even among accurate solver's, so ft Is unlikely 
that they reflect a real misunderstanding of the syntax of expressions. 
Rather, It seems that the patterns of parentheses is just not as salient 
as It shoyld be, and when solvers are blocking out the structure of ex- 
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presslons it may be'overr I dden by such other grouping factors as the 
repeated form in equation 6B. Unfortunate! y i t se4ms that it is the 
absence of parentheses, rather than presence, that is most frequently 
overlooked, so devices to draw attention to the parentheses might be in- 
effective. Perhaps students^uld rewrl te - k^ppess Ions with extra spacing 
between terms that are not within parentheses. 

Some students, such as the one who cq«fu««d ''one oyer two x" and 
"one-hal f ,x*^ do have trouble with the syntax of^ expressions . ^Probably 
more confusions about syntax are inasked by the generic deletion and 
recombination operators, which blur many distinctions* Since expressions 
are representations of calculations, and the syntax is intended to cap- 
ture the ne^ssary information of order. of operations and assignment of 
arguments to arithmetic operations, students might benefit from exercises 
in which complex calculations were to be written as exp^ressi ons • Programs 
for a computer or calculator might be good representations of calculations 
from w^ich to translate to expression form. 

Like appl icabi 1 i ty error?, execution errors are relatively common 
even among accurate solvers. Also, there is not the clumping of these 
errors that is seen with some of the operator errors: no solver had more 
than 3 partial execution or control failure errors in Session 1. It is 
plausible that there is a tradeoff of speed and accuracy In equation 
solving as with pthar tasks, and that the price In efficiency of carry- 
ing out all operations flawlessly would be very large* More data would 
be needed, hc^ever, before it cou4d be concluded that students' execution 



accuracy could not be Improve^ wl t ho loss of efficiency. 

Good solvers Not much was learned about the differences between more 

and less accurate solvers. There were a few glimpses of the kind of per- 
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formance one might tiave expected of expert sol vers » but no sharp con- 
trasts on a group basis between the most and least accurate soWers in 
the study beyond the difference in accuracy itself. .There were sugges- 
tions of tighter strategic control, indexed by agreement wi th the basic 
Bundy strategy, more economical solutions, and greater use of repeated 
subexpressions as units of analysis. Further wo^fc with more challenging 
problems and more experienced solvers might sharpen and add to these 
iadi cat tons. 

Kinds of knowledge in algebra Equation solvers have to know a set of 

correct operators, They also have to know what to do to an equation, to 

move it closer to solutipn, and what operators will help. To decide 

w,hat to do to an equation, the solver must know what features of an equa 

tion, such as number of Instances of the unknown In a denominator, are 

important in deciding what to do. We have presented difficulties that 

reflect voids or distortions in these bodies of knowledge. 

We argued that operators are not simple units of knowledge- (t 

appears that there are operators like "factor" that have other operators 
i 

as parts so that the student can use the notion "factor'^ in planning, 
and then expand it into its constituents when it must be carried out. 
Even operators that do not seem to have other operators a^' part* seem 
to have structure, In that a studeet may have only partial knowledge of 
them. Part of the knowledge of adding and multiplying seems to be that 
they accumulate things, while subtraction and divlslcy^ both take away 
things. We have argued in the case of recombination and deletion errors 
that these pieces of partial knowledge can determine the form and occur- 
rence of errors. 

Strategic knowledge is aUo not simple, or at least ndt as simple 
as In the Bundy model. It appears that a solver needs to distinguish 



linear from quadratic equations, and have a different plan for each. 

When the unknown is present In ^ denominator, a check for extraneous root 

must be appended to the normal plan. The solver must know that if there 
are no occurrences of^ the unknown somethl ng^has gone wrong, and that 

multiple occurrences of the unknown must be reduced to one before the 

equation is solved. At a more tactical level, the solver has to know 

what operators to use to collect occurrences, including the situation 

In vyhich one occurrence has an implicit a§ its coefficient. An- - 

other important area of tactics is the handling of x In the denominator 

especially the often baffling form 'M/x ■ expr^', Many solvers have ex- 

plldlt;^ knowledge of all of these things, many have implicit knowledge, 

but many have no knowledge of some of them^ 

So much for basic equipment. A student who had the'abbve knowledgeP 
would be a good solver. But. it appears that there are other thing: that 
a solver should know, that are not parts of the skill itself, but cr^ 
important In creating and maintoining the skill, , 

We have already touched on the importance of knowing how to tell a 
correct operator fronv*an incorrect one. It appears that every student 
must encounter wrong ideas of operators. These may be formed by the 
student while learning in class or from'a text, or while attempting to 
apply already learned material. They might originate In a misanalyzed 
example, trf^ false Inference, or simply through memory failure. The 
Student must be able to detect and reject theie false Ideas. 

Despite the importance of tn!s ability, some students appear to 
have^ no idea why some operators that mlghtv occur to them are valid and 
others are not, beyond appeal to authority. Asked abouc an error \n 

p 

combining fractions, pne student s«id« "WeJI , I can't tell you what the 
rule is but I've seen it done before." ^ Ttjfe Aore extensive reinarks of 
another student are excerpted fn Figures 8.1. 
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Figure 8 J 



Comment on knowing the rules 



E; asks about what^ule is used transforming 
•ax+bx-2x » 2>/ab* to *a+b-2 « 2-b^ 
• 

S: "Mostly what I've been doing Is just mainly 
frotn memory or its been trying to be from 
menx>ry. I knoc; there's a lot of rules in 
algebra that you have to learn first before 
you can go on to you know, that's the nx>st 
important thing Is to learn those rules... 

If I had a book maybe... 

I personally can't remember anything about 
those.. You have to go ask the teacher." 



E: "Ah, so again I'm asking you for help. \i 
there, a rule you could tell me that would 
tell me when I could cancel something of that 
soVt...?" - 

S: "That could tell you, that J_ could tell you, 
no.. The book coi/ld tell you, yes" 

E: "I mean apart from asking someone if there is 
any way that I could figure out whether a 
particular thing that I'm doing would be 
correct or^whether it wouldn't be? Can you 
give me any advice along those lines?" 

S; 'It's always safe to ask the teacher if you 
don't know something. Maybe consult with a 
fMend who is doln^wcll in the subject or 
knows what he's doing,*' 

E: *Mf I'm all Jby myself in a locked room or some- 
thing is there some way I could figure it out, 
like is there some way I coufd relate it to 
other things that 1 mlgKt know about algebra 
or 4o I have to, you know, are the rules just 
things th«t you have to know or«.,^' 



S: ' You're going to have to knwm the rules. Whether 
^'<tr not you can know If Its the end of the problem 
pretty much depends on how much you have studied 
and how much, you know. You know again ft re-^ 
lates back to the^rules/' 
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There seem to be two ways' students might , test the' validity of 
theff* ideas, use of principles and checking. "Principles" refers to 
the basic mathematical properties of the arithmetic operations that 
underlie the manipulations of algebra: that mul t'ipl icatlon distributes ■ 
over addition, that multiplication and division are inverses, and so 
'on. A student who knew these principles well could reject operations 
that could not be derived from them. Unfortunately, the basic prin- 
ciples are almost as numerous and complex as the algebraic operators 
based on them, so students will be doubtful about them. Further, the 
testing of an operation by use of the , principles Is an exercise In 

ft' 

♦ \ 
proof, and may require sO(re creativity. It is not transparent how ' 

cross multiplication is related to the basic principles, for example, 

because the operation as It Is performed suppresses the underlying 

- » 

mul 1 1 pi i cat Ions , . 

In our earlier discussion of checking we distinguished g'lobal and 
local nxjthpds, where local methods are those that can provide Informa- 
tion about the correctness of a single st^p. Of these^ trial evaluation 
seemed to be the method to prefer, for poor solvers, becaqse of Its 
generality and ablltty to detect both stable and transient errors, 

» 

While the bisic 'trial execution method Is applicable cllrectly 
only to steps that replace an expression by an equivalent one ( reductions 
In the terminology of Matz, 1979a), It can be extended to most deduc- 
tions , steps that transform'the entire equation, as follows, htost dc- 
ducttor can be analyzed as performance of the same operation on both 
sides of an equation, and simplification. Under this decomposition. It 
is the slmpl If Icatfons where many errors occur, and the simplifications 

* # , 
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are reductions , that can be checked by trial evaluation. Figure 8.2 
shows how this method could be'used to detect an"invalld operation on 
reciprocals. . ' , , ' . 

Two deductions to which the method cannot be applied are splitting 

/ f 

of a quadratic equation by factoring, and use of the quadratic formula. 
These cannot be analyzed as performing the same operation to both sides 
of the equation. Cross multiplication is a borderline case* It can be 
analysed as multiplying both sides of the equation by the product of the 
deno^ninators, and then simplifying, but as was said above this analysis 
is not obvious. • , 



Figure 8,2 



Use of trial ^evaluation to cheeky 
an ojjeration on reclprofals 



Problem: Can 



1^1 



be replaced by a + b? 



Check: 



Substitute a - 2, b - 3 



1 



-4- 

a b 



1 



2 ^ 3 



5 



a + b 



-> 2 + 3 



^ 5 



_ , 6 

p r J , so replacement is not valid. . 



^ 128 



Despite these' limi tatl ons , it appears that "checking by triaV' 
education might help students filter good ideas from bad. But would 
they use it? One promising indication is- that students do seem often 
to be aware that they are performing doubtfui,,_ope rat ions , as some of the 
comments collected in thi.s report show. Thus they recognize some occa- 
sions when local checking would help them, If they knew about It. ^ 

^ Lack of knowledge of how to check is probably not the only reason 
students do not check, however^ Checking is taught as a means of in- 
creasing accuracy. As long as checking is just a way to be more sure 
of the answer to a given problem, students are free to use it or not 
according to the accuracy and time pressures they feel. For good solvers, 
it is often rational not to, check for this reason. Poor solvers, however, 
need to see checking as a way of evaluating their knowledge , not their 
answers. 

This leads to the last kind of knoi^l^edge of algebra that we will 
discuss. Students need to know how to distinguish incorrect operators 
from correct, ones but they also need to see how this ability fits, irfto 
the learning task. They need to know that they will form misconceptions 
and make en-ors, despite their best efforts, and that there are specific 
actions they can take to deal with these difficulties. Testi,ng and 
correction of knowledge should be seen as a normal and important activity, 
not as an option, or worse, as something good students could avoid. Dis- 
cuss-ion of common errors, with emphasis on the often sensible analysis 
that lies behind th^m, might help develop the Wcestary perspective on 
learning. 
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Meaning in algebra As the Bundy program Illustrates, one can do algebra 
without understanding it, In the sens^ of being able to assign any mean- 
ing to the entities being manipulated. We 'have seen that there is very 
little evidenj:.e that the human solvers in the study made use of meanings 

r , 
\ 

in their work. We have suggested nevertheless, that riieaning Is important 
when knowledge of algebra is learned or recalled. This seems true not 
just because of the helpful redundancy that any Interconnections In a 
body of knowledge seem to provide, but because of the specific role mean- 
ing can play In allowing the validity of operators ta be tested, as in the 
trial evaluation method. There the relation between express I ons^ and cal- 
culations IS Central. . Another area \r\ which we have suggested, th I s rela- 
tion could be useful is In learning the syntax of expressions. 

The expression-calculation system is an interesting dofiiain of appli- 
cation of Greeno's (1978) ideas on understanding. ' Greeno suggests an 
analogy with language cofnprehens ion ,i in which to understand an entity, say 
a sentence, Is to have an Internal representation of It that Is coherent, 
connected to' other relevant knowledge, and accurately captures the essen- 
tial features of the entity. In the expression-calculation domain, under- 
standing an expression means being able to construct an Internal represent- 
ation of a calculation? The calculation that the expression represents\ 

To straighten out these many uses of *Vepresent'\ let us try to 
trace the parallel with sentence compreheps 1 on more closely. When a 
sentence is understood, the Internal representation of It has to be more 
than a coding of the sounds, say ^ that make up the sentence. It is'common 
to claim that the representation should be a propos I tlon (or set of pro- 
positions). But propositions are not things tha*- can exist ?n someone's 
head, so the representation of the sentence Is not really a proposition 
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but a representation of a proposition. In the same way, the internal 
representation of an expression would not be a calculation, but a re- 

■presentation of a calculation. Finally, what proposition is i t whose 
representation iS the appropriate representation of the senter^ce? Just 
the proposition that the sentence itself represents. Figure 8.3 shows the 

^analogy between sentence and expression and calculation graphically. 

This lingutstic analogy may be helpful in clarifying how establish- 
"ng calculations as meanings for expressions could i:^elp students. There 

Is research Indicating that having meanings assigned helps enonrously In 

\ 

V 

the learning. of the syntax of artificial languages (Moeser & Bregman, 

. 1972, 1973). The problem of learning operators that preserve the meaning 

of expressions might seem to-be parallel to the problem of learning mean- 

# 

i ng-preservlng t ransformat Ions , but it is not. The operat lon^ of algebra 
do not alter the rules of syntax for expressions: an expression with zero 
added to it has the same syntat i c rules of formation of any other expres- 
sion. A passivized sentence may likewise have the same surface grammar as 
sentences generally. But a sentence like ''John gave Mary the book/' does 
ngt follow the ordinary rules of syntax. So learning mean! ng^preservi hg 
transformations cannot be separated from learning the syntax of sur- 
face strings in the/same way that learning algebraic manipulations 
can be separated friom learning the syntax of expressions. 
Errors and the psychology of skill Matz (1979a) and Brown (1979) 
have outlined related theories of the origin of errors In skilled per 
formance. In both theories, errors arise when Inconiplete knowledge is 
extended to cover a new problem, and the nature of the error that Is 
nvade'in the extension process is influenced by the partial knowledge 
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Figure 8* 3 



ParaHel between understanding a sentence 
and understanding an expression 
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Sentence 



represents 



Mental 

Representat i on 




Propos i t i on 



represents 



To understand'a sentence, one needs a mental representation 

of the proposition. 



Expression 



^^Representat ion 



represents 




Calculation 



represents 



To understand and expression, one needs a mental representation' 
of the calculation. 
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that Is availalle, und by Ideas the subject has about the oii^racter of 
the operations being learned or applied. 

•n Matz's theory, operators are constructed from the partial know- 
ledge available, and then filtered by a family of "critics" which accept 
or .reject the construction according' to whether it has certain desirable 
^ general properties. For example, Matz suggests that an operator In alge- 
bra should "touch every part": it should not ignore any piece of the ex-, ^ 
presslon or expression being transformed. Most' actual operators have 
this property,, though there are exceptions. For example, replacement 
of 0 expr by 0 does not require any testing, analysis, or copying of 
expr. Matz argues that students are likely to' make general izat ions ^^ilce^ 
"touch every part" and that the! r constructed operators will be made to 
obey the general Izv^cions. ' ' 

In Brown's tl^eory, developed most fully for algorithms in arith- 
metic, students try to apply their existing partial algorithms and run 
into missing or impossible steps. They then use their accumulated 
general knowledge to "patch" their algorithm so that It. can be executed ■ 
to completion. In the patching process they use knowledge about the 
c-haracter of familiar and likely steps, Information about the desJ red 
outcome of the ialgorlthm, and also about features of the -execution 

process Itself: the algorithm should not loop, for example." 

. n . 

While these theories specify mechanism^ for the productlon'of 
errors, the mechanisms are quite flexible, and depend heavily on the - ' 
specific knowledge possessed by.a.solver to shape errors. Conse- 
quently, It is difficult to support or falsify these Ideas by an exam- 
ination of errors such as those we have- selected. Considering students' 
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comments^ we did not find students articulating principles like ''touch 
every part*\ and these would have to be implicit knowledge for our Solvers 

Students' comments do show, however, that the sort of stretch mg 
of knowledge called for in both theories does occur for many solvers, 
and a few of the protocol excerpts presented Indicate some oi; the know- 
ledge solvers ^ring to bear on the problem. For example, in case S5 6C 
In Table 5.8 shows the erroneous application of cross multiplication 
halted by the appearance of a second equal sign, which violated the stu- . 

a 

dents ^ knowledge of the form of an equation. Above the level of individ- 
ual operators^ we. have examples showing a number of Indicators of pro- 
gress or trouble that students use, collectedMn Table 7.5. 

We have obtained some general support, then, for the ideas'of Matz 
and Brown, and soTie specifics. U might be possible to fill In m(§re of 
the details in these schemes by asking students to evaluate operators 
,4>roposed by the experimenters. This might elicit more comments from the 
students we obtained, as well as getting a more complete picture of the 
criteria students may be using by going beyond just self-generated errors. 

Two particular categories of errors which might repay further ^naT- 
ysis are deletion and reconibi nation errors. While these are perhaps 
consistent with the Matz or Brown mechanisms, it seems that these erc<^i*!$ 

/ 

originate from general Ideas of the task, rather than just being 
passed b^ critics that embody this knowledge, as In Matz's view, or 
rpluUing. f row a patch on a mutilated algorithm. Since algebra, can 
^be thought 'of as an exert,lse In puris symbol manipulation j It Is 
tempting to Imagine that students might organ I zi; tftef r knowledge of 
operators around the key notions of deletion and rearrangement, and 



50 develop pperators to perform these functions. The existence of 
several different deletion operations, and of restrictions on re^ 
arrangtrnt^nt might be seen as detail that could be suppressed. If 

this' analysis Is correct, It places the origin of some errors closer 
to the center of the learning process than the critics or patching 
mechanisms of Matz' and Brown, ^ 
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